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Printing  History 

The  development  of  KPIs  and  the  implementation  of  data  reporting  processes  involved  working  with 
committees  representing  each  of  the  major  sectors  of  the  post-secondary  system  (public  colleges, 
technical  institutes,  and  AVCs;  universities;  and  private  colleges).  In  each  case,  a “reporting  manual” 
summarized  all  of  the  agreements  made  between  the  institutions  and  the  department.  Because  each 
committee’s  work  proceeded  at  a different  pace,  the  early  versions  of  this  manual  appeared  as  separate 
manuals  for  each  sector.  During  1996-97  it  became  possible  for  the  three  manuals  to  be  consolidated  into 
one  to  better  reflect  and  facilitate  an  important  part  of  the  original  objective,  which  was  to  develop  a set 
of  indicators  that  would  apply  system-wide.  This  is  the  second  edition  of  that  common  manual. 


Reporting  Manuals  for  each  sector 

Colleges  & Technical  Institutes 

September  1995  (Pilot  Draft) 

May  1996  (Pilot  Draft  - Round  Two) 

November  1996 

Universities 

Fall  1 995  (Pilot  Draft,  Round  One  was  available  in  electronic  form  only) 
June  1996  (Pilot  Draft  - Round  Two) 

December  1996 

Private  University  Colleges 

Spring  1997  (available  in  electronic  form  only) 


Common  Reporting  Manual 

November  1997 

This  edition  consolidates  and  replaces  the  separate  manuals  prepared  for  each  institutional  sector  for  the  pilot  and  start-up  year  of  data  collection. 

December  1997 


This  version  includes  correction  of  errors  and  omissions  as  at  December  15,  1997. 


December  1998 


Reporting  Software 

Reporting  software  has  been  produced  to  accompany  this  manual.  Version  5.0  is  the  first  version  that 
will  be  provided  to  the  universities.  That  version  can  allow  universities  to  report  only  partial  data;  they 
will  receive  a version  that  allows  complete  reporting  just  as  soon  as  the  universities  are  part  of  the 
system-wide  enrolment  and  program  reporting  system. 

Version  1.0  - May  24,  1996 
Version  1.01  - June  25, 1996 
Version  1.2  - September  9,  1996 
Version  1.3  (B)  - November  1996 
Version  2.0  - November  1996. 

Version  2.1  - November  1997. 

Version  2.2  - December  1998  - to  accompany  this  manual 
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Major  Changes  from  Earlier  Editions 


• the  Introduction  sections  have  been  updated  and  consolidated 

• KPI  Contacts  have  been  updated 

• the  Special  Situations  In  KPI  Reporting  section  has  been  removed.  Up  to  date  information 
about  how  CIS  deals  with  these  special  situations  can  be  obtained  from  the  CIS  Reporting 
Manual 

• the  Data  Elements  & Reporting  Systems  tables  have  been  revised  for  a number  of  indicator 
data  sets  to  correspond  more  closely  to  the  formats  of  KPIRS  data  entry  screens  and  to  reflect 
the  current  (December  1998)  status  of  university  implementation  of  CIS 

• the  Access  Indicators  section  has  been  revised  to  include  the  specifications  and  protocols  for 
Non-Credit  reporting  which  commences  with  this  reporting  cycle 

• the  new  Guidelines  for  Conducting  KPI  Employment  and  Satisfaction  Surveys 
(November  4,  1998)  and  associated  survey  questions  and  formats  are  included  in  an 
appendix  to  the  Manual.  These  guidelines,  questions  and  formats  take  effect  for  surveys  of 
1998-99  graduating  students 
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INTRODUCTION 


This  Manual 

This  manual  has  been  prepared  to  assist  institutions  with  assembling  and  submitting  Key  Performance 
Indicator  data  to  system- wide  databases.  It  sets  forth  guidelines  and  describes  methods  and  procedures 
for  reporting  data  that  is  not  collected  through  the  Common  Information  System  (CIS)  or  the  Financial 
(and  related)  Information  Reporting  System  (FIRS).  It  is  to  be  read  along  with  a separate  publication: 
Common  Terminology,  Definitions,  and  Classifications. 

A Brief  History  Key  Performance  Indicator  Reporting 

Work  on  the  development  of  new  accountability  arrangements  was  marked  in  the  fall  of  1993  with  the 
distribution  of  a discussion  document  prepared  by  Advanced  Education  and  Career  Development.  The 
department  invited  institutions  to  name  committees  with  which  the  department  could  discuss  these  new 
arrangements  and  the  development  of  performance  indicators.  From  an  early  stage,  the  development  of 
indicators  was  seen  as  a long-term  project  operating  in  several  phases:  'Phase  One”  involved  developing 
and  piloting  a basic  set  of  Indicators  using  pilot  data  for  the  1994-95  academic  year.  The  pilot  year  - 
1995-96  - was  intended  to  give  both  the  institutions  and  the  department  a chance  to  run  some  real  data 
through  the  system. 

The  1995-96  pilot  year  officially  got  underway  when  the  first  versions  of  a manual  for  KPI  reporting 
were  distributed  in  September  1995.  The  data  collection  that  followed  Identified  a number  of  problems. 
The  scope  of  the  pilot  was  changed;  the  problems  were  resolved;  the  manuals  were  revised;  and  reporting 
software  was  added.  Revised  manuals  and  reporting  software  were  distributed  in  May  1996  to  initiate  a 
second  round  of  pilot  data  collection.  The  second  round  of  the  pilot  raised  new  issues,  and  the  resolution 
of  those  issues  was  reflected  in  the  reporting  manuals  published  in  November  1996. 

Early  in  1996,  Initial  work  on  KPI  development  for  private  colleges  was  suspended  to  ensure  that  the 
pilot  rounds  and  the  initial  year  of  start-up  phase  reporting  for  other  sectors  were  successful.  This  had 
some  practical  advantages  to  the  extent  that  the  KPIs  for  the  private  colleges  are,  for  the  most  part,  a sub- 
set of  the  universities  indicators,  with  additions  and  specializations  appropriate  to  the  private  college 
sector.  Work  with  tide  private  colleges  resumed  in  the  spring  of  1997;  a draft  manual  was  produced  and 
pilot  and  start-up  years  data  assembled. 

In  the  fall  of  1997,  a single  KPI  reporting  manual  for  all  sectors  was  released  along  with  a “data 
dictionary”  containing  terminology  and  definitions  common  to  KPIRS  and  FIRS.  That  manual  also 
contained  as  an  appendix  the  agreement  made  with  institutions  for  reporting  non-credit  activities. 
Institutions  were  given  a full  year  to  organize  their  systems  to  be  able  to  report  non-credit  activities  more 
comprehensively  starting  in  the  fall  1998  reporting  period.  This  manual  and  die  accompanying  software 
allows  institutions  to  report  their  non-credit  activities  according  to  the  standards  that  were  agreed  upon. 

By  the  same  token,  over  the  past  year,  the  department  and  the  institutions  have  agreed  upon  new  data 
collection  standards  for  employment  and  satisfaction  information.  That  new  agreement  is  included  as  an 
appendix  to  this  manual  so  that  institutions  will  have  a ready  reference  for  what  will  be  the  reporting 
standard  next  year. 
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Illustration  1 - Collection  and  Use  of  Data 
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Uses  of  KPI  data 

This  data  has  been  reported  by  institutions  in  all  sectors  and  used  in  the  first  and  second  pilot  years  of 
implementation  of  the  Performance  Funding  Envelope.  The  full  data  set  for  all  institutions  has  been 
made  available  to  each  institution.  The  data  is  also  used  in  the  annual  system  performance  report 
expected  before  the  end  of  the  year.  The  accompanying  diagram  outlines  the  major  uses  of  the  data  by 
the  department. 

Common  Definitions 

The  manuals  and  documents  that  this  manual  replaces  contained  definitions  of  various  terms  used  in  CIS 
reporting.  These  definitions  are  now  included  in  a compilation  of  Common  Definitions,  Terminology 
and  Classifications.  The  Common  Definitions  document  has  now  become  and  will  be  maintained  as  the 
authoritative  source  for  terminology,  definitions  and  classification  structures  for  information  reporting 
and  exchange  between  and  among  Alberta  post-secondary  institutions  and  the  department,  including  CIS, 
FIRS,  and  KPIRS. 

The  Common  Definitions  document  is  a companion  document  to  this  manual  and  should  be  read  in 
conjunction  with  it.  Although  this  Manual  may  contain  definitions  and/or  descriptions  of  some  terms, 
the  Common  Definitions  is  the  authoritative  source  and  should  be  consulted  for  the  most  complete  and 
up-to-date  definitions. 

The  Common  Definitions  document  is  available  through  the  department’s  website  at 
www,  aecd.  gov.  ab.  ca/software. 

Data  Collection  Systems 

KPIRS  is  one  of  the  data  collection  and  reporting  systems  that  ensure  consistency  in  reporting,  storing, 
and  using  data  across  Alberta’s  post-secondary  system.  Each  of  these  systems  includes  both  manuals  and 
software: 

CIS  (Common  Information  System)  - CIS  includes  two  subsystems  for  data  reporting:  one  dealing 
with  student  information,  and  the  other  dealing  with  program  information.  Used  together,  these 
components  support  the  collection  of  data  for  the  generation  of  enrolment  reports,  as  well  as 
student  characteristics,  program  and  other  information. 

FIRS  (Financial  Information  Reporting  System)  - FIRS  deals  with  revenue,  expenditure  and 
related  financial  data,  tuition  fee  data,  and  basic  information  on  facilities  and  staff. 

KPIRS  (Key  Performance  Indicator  Reporting  System)  - KPIRS  uses  data  institutions  provide 
through  CIS  and  FIRS,  and  additional  data  institutions  enter  directly  through  KPIRS  software,  to 
calculate  agreed-upon  key  performance  indicators.  Only  those  institutions  that  use  CIS  are  able  to 
use  all  of  the  KPIRS  reporting  capabilities. 

The  software  component  of  each  of  the  data  collection  systems  is  a user-friendly  electronic  tool  to  enable 
Institutions  to  submit  data  in  a consistent  way.  These  tools  have  been  developed  by  AECD  using 
Microsoft  Visual  FoxPro  and  can  be  used  individually,  or  as  a suite  with  a common  launch  facility,  a 
number  of  shared  data  tables  and  services,  and  a common  procedure  for  creating  files  to  export  to  the 
department.  These  features  minimize  the  duplication  of  data  entry,  and  eliminate  data  entry  errors  at 
AECD.  The  system- wide  databases  that  are  created  enhance  the  comparability  of  information  between 
institutions  within  the  same  sector  and,  to  the  extent  possible,  across  the  various  sectors  of  the  post- 
secondary system. 
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Typical  Process 


Date 

CIS 

FIRS  KPIRS 

April 

Government  fiscal  year  runs  from  April  1 to  March  31. 

Institutions’  Business  Plans  are  due. 

June 

A “System  Performance  Report” 
will  be  published. 

July 

July  submission  (Winter  & Spring] 
is  due  on  or  before  July  31. 
Academic  year  data  finalized. 

September 

Once  CIS  data  are  available,  the 
department  provides  lists  of 
students  to  the  seven  colleges  with 
University  Transfer  (UT)  programs. 
This  starts  the  data  collection 
process  for  the  UT  Leavers 
indicators. 

October 

Updates  to  CIS  data,  such  as  late 
graduates,  are  due  as  soon  as 
possible  after  the  academic  year 
ends,  but  no  later  than  Oct.  15  to 
ensure  inclusion  in  KPIRS. 

Seven  colleges  with  UT  programs 
submit  their  UT  “leaver”  file  to 
Alberta  Council  on  Admissions 
and  Transfers  (ACAT). 

All  institutions  are  to  submit 

Duplicate  Application  Data  (DAD) 
files  to  ACAT  by  October  30. 

The  department  will  extract  some 
information  for  the 

Demand/Capacity  indicator  from 

DAD  and  transfer  it  to  KPIRS. 

November 

Data  requested.  Any  necessary  software  upgrades  are  issued  by  AECD 
to  all  institutions,  along  with  any  revisions  to  reporting  manuals. 

CIS  data  on  record  as  of  October 

30  are  transferred  to  the  KPIRS 
database. 

ACAT  will  report  UT  leaver  results 
to  institutions. 

January 

FIRS  and  KPIRS  submissions  are  due  on  or  before  January  31 . FIRS  and  KPIRS  data  should  be  submitted 
earlier  if  possible  to  allow  ample  time  for  the  department  to  determine  funding. 

CIS  data  (the  December  submission  for  the  academic  year  in  progress)  is  due  by  January  31. 

February 

The  data  to  be  used  in  performance-based  funding  is  checked.  Indicators  used  in  performance-based  funding 
are  calculated  for  those  funding  decisions. 

March 
& later 

The  remaining  data  is  checked  and  entered  into  system-wide  databases.  The  data  is  made  available  for  use  in 
other  policy  and  funding  decisions  both  in  the  department  and  in  the  institutions. 
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These  data  collection  systems  are  the  responsibility  of  the  System  Information  Branch  of  the  Learning 
Support  and  Accountability  Division  of  Alberta  Advanced  Education  and  Career  Development.  The 
names  of  the  individuals  responsible  for  Key  Performance  Indicators  appear  in  bold  in  the  following 

table: 


System  Information  Branch 
Learning  Support  and  Accountability  Division 
Phone:  415-2252  Fax:  427-5920 


Name 

Title 

Phone 

E-mail 

(@aecd.eov.ab.ca) 

Orton,  Larry 

Director 

427-5630 

larry.orton 

Kashman,  Jean 

Manager,  Program  Information 

Acting  Manager,  Enrolment  & Student  Information 

427-7146 

jean,  kashman 

Nicely,  Steve 

Senior  Business  Analyst 

422-4847 

steve.nicely 

Malcolm,  Peter 

Manager,  Financial  Information 

427-5633 

peter.malcolm 

Holms  trom,  Linda 

Business  Systems  Analyst  & Coordinator, 

Enrolment  and  Publications 

422-5054 

linda.holmstrom 

Piche,  Kathy 

Business  Systems  Analyst  & Coordinator,  Key 
Performance  Indicators 

422-5052 

kathy.piche 

Gnanasihamany, 

Tony 

Business  Systems  Analyst  & Coordinator, 

Financial  Information 

422-5050 

tony  .gnanasihamany 

Myshak,  Wendy 

Project  Assistant 

422-3103 

wendy  .myshak 

Jamani,  Zarin 

Secretary 

427-1819 

zarin  .jamani 

Selk,  Kathy 

Data  Administrator 

415-2255 

kathy.selk 

The  software  systems  have  been  written  by  the  Information  Management  Branch  and  are  provided  to 
institutions  for  use  on  their  own  hardware.  Institutions  need  to  ensure  that  this  software  is  installed  on 
equipment  that  meets  or  exceeds  the  minimum  operating  requirements  as  specified  in  documentation 
accompanying  the  software.  The  department  provided  special  funding  to  the  institutions  to  ensure  that 
they  have  the  appropriate  equipment,  and  that  the  collection  of  information  at  the  institutions  is 
enhanced. 

Creating  and  Submitting  Data  Files 

The  reporting  software  for  each  data  reporting  system  allows  the  user  to  create  an  electronic  file  of  the 
data  that  has  been  entered  and  that  needs  to  be  submitted  to  the  department.  Details  on  how  to  do  this  are 
provided  in  a separate  User  Guide  for  the  software. 

When  you  are  ready  to  submit  data  to  the  department,  you  can  use  the  department's  FTP  site,  e-mail  the 
data  files,  or  mail  or  courier  diskettes. 

The  preferred  method  for  doing  this  is  a file  transfer  protocol  (FTP)  application. 

• FTP 

Any  file  transfer  protocol  (ftp)  application  Is  acceptable,  although  we  recommend  FTP  Explorer. 
This  is  available  as  shareware  on  the  Internet  at  www.tucows.com. 

Most  institutions  use  the  department’s  FTP  site  for  submitting  data.  (System  Information  uses  the 
same  site  to  send  data  back  to  institutions.)  Details  on  how  to  use  the  AECD  FTP  site  are  given  in 
the  User  Guide  that  accompanies  the  software.  If  you  use  the  FTP  site,  please  notify  the  System 
Information  Data  Administrator  when  the  data  has  been  posted  to  the  site. 
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• e-mail 

If  you  e-mail  the  data,  please  send  the  files  as  attachments  in  an  e-mail  to  the  System  Information 
Data  Administrator. 

• mail  or  courier 

If  you  send  the  data  by  mail  or  courier,  then  copy  the  file  to  diskette  and  send  it  to  the  System 
Information  Data  Administrator. 


Contact  information: 


Phone:  415-2255 


Kathy  Selk,  Data  Administrator 

System  Information  Branch 

Learning  Support  and  Accountability  Division 

10th  Floor,  Commerce  Place 

10155  102  Street,  Edmonton,  AB  T5J  4L5 

E-mail:  kathv.selk@,aecd.gov.ab.ca 


Data  To  Be  Reported 


FIRS 

KPIRS 

CIS 

Date  due 

Data  expected 

Date  due 

Data  expected 

Date  due  | 

Data  expected 

This  reporting  year 

Jan.  31, 

1996-97  Actuals 

Jan.  31, 

1997-98  data.  Updates 

Jan.  31, 

1998-99  December 

1999 

1997-98  Actuals 

1999 

and  outstanding  data 

1999 

submission  (summer  and 

1998-99  Actuals/Forecast 

from  previous 

fall  1998  data). 

1999- 00  Plan 

2000- 01  Plan 

submissions. 

July  31, 

1998-99  July  submission 

1999 

(winter  and  spring  1999 
data).  1998-99  academic 
year  data  finalized. 

Oct.  15, 

1998-99  updates,  such  as 

1999 

late  graduates,  may  be 
submitted  after  the 
academic  year  ends,  but  no 
later  than  Oct.  15. 

FIRS 

KPIRS 

CIS 

Date  due  | 

; Data  expected 

Date  due 

| Data  expected 

Date  due 

Data  expected 

Previous  reporting  years 

Jan.  1998 

1995-96  Actuals 

Jan.  1998 

1996-97  data. 

Jan.  31, 

1997-98  December 

1996-97  Actuals 

1998 

submission. 

1997- 98  Actuals/Forecast 

1998- 99  Plan 

1999- 00  Plan 

July  31, 
1998 

1997-98  July  submission. 

Oct.  15, 
1998 

Updates  for  1997-98. 

Nov.  1996 

1994-95  Actuals 

Dec.  1996 

1995-96  data. 

Jan.  31, 

1996-97  December 

1995- 96  Actuals/Forecast 

1996- 97  Budget 

1997- 98  Plan 

1997 

submission 

1998-99  Plan 

July  31, 
1997 

1996-97  July  submission. 

June  1996 

1993-94  & 1994-95 

Pilot  year 

1993-94  and  1994-95 

as  above 

as  above 

Revenue  & Expenditure 
data  only. 

data. 
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Listservers 

A listserver'  is  an  automated  facility  for  exchanging  electronic  messages  among  a group.  By  addressing 
a message  to  just  one  location  (a  computer  ’server’)  you  are  able  to  send  the  message  to  a group  of  people 
(the  list’).  Individuals  can  put  themselves  on  the  list  either  by  sending  a message  to  the  computer,  which 
automatically  grants  “membership”  on  the  list,  or  by  asking  the  person  who  maintains  the  list  to  be 
included.  Or  the  person  who  maintains  the  list  can  enter  names.  However  names  are  added,  any  message 
addressed  to  the  server  is  automatically  distributed  to  everyone  on  the  list.  The  use  of  listservers  hosted 
by  institutions  on  a voluntary  basis  has  been  of  enormous  benefit  to  those  working  on  CIS  and  related 
projects. 

The  department  has  now  established  a set  of  listservers  to  facilitate  communication  on  all  work  related  to 
CIS,  FIRS,  and  KPIs.  The  department  will  ensure  that  each  institution’s  official  contact  for  each  of  these 
systems,  and  each  institution's  contact(s)  for  related  areas  are  included  as  listserver  members;  and  that 
member’s  addresses  are  either  up-to-date  or  deleted  [see  note  below].  Others  are  welcome  to  join. 

To  join  or  to  quit  one  of  the  listservers,  or  to  get  a list  of  the  members  of  the  listserver,  send  the 

message 

subscribe  kpi,  subscribe  cis,  or  subscribe  firs  to  join  the  listserver  of  your  choice 

unsubscribe  kpi , unsubscribe  cis , or  unsubscribe  firs  to  quit  the  list  of  your  choice 1 

who  kpi , who  cis,  or  who  firs  to  get  a list  of  subscribers 

and,  in  each  case,  address  the  message  to  tnajordomo@www.aecd.gov.ab.ca. 

To  send  a message  to  everyone  on  one  of  the  listservers,  address  your  message  to  the  appropriate 
listserver,  as  follows: 

for  the  KPI  Listserver  KPI@www.aecd.gov.ab.  ca 

for  the  CIS  Listserver  CIS@www.aecd.gov.ab.ca 

for  the  FIRS  Listserver  FIRS@www.aecd.gov.ab.  ca 

The  listservers  will  be  maintained  by 
Kathy  Selk 
Data  Administrator 
System  Information  Branch 
Learning  Support  and  Accountability  Division 
Telephone:  415-2255 

E-mail:  fcafhv.seik@  aecd.gov.ah.ca 


Information  specific  to  KPIRS 

Since  KPI  data  is  obtained  somewhat  differently  for  each  indicator  set,  the  way  in  which  the  data  is 

obtained  is  explained  in  detail  in  the  section  of  the  KPI  Reporting  Manual  describing  each  set. 

Other  key  information  follows: 

• When  the  KPIRS  software  is  ready,  it  is  distributed  to  institutions  once  their  CIS  data  is  received  and 
finalized.  Institutions  whose  current  year  CIS  data  Is  not  yet  ready  will  receive  the  KPIRS  software 
when  their  CIS  data  is  ready. 

• The  KPIRS  software  distributed  in  the  fall  of  1997  (Version  2.1)  was  the  first  version  provided  to  the 
universities.  However,  since  the  universities  were  not  entirely  part  of  CIS  at  that  time  they  received  a 
limited-functions  edition  able  to  report  only  data  that  is  not  dependent  on  CIS.  This  fall  - the  fall  of 
1998  - the  University  of  Lethbridge  is  using  CIS  and  will  be  able  to  use  the  fully  functioning  version 
of  KPIRS.  The  other  universities  will  receive  a specially  adapted  version. 


1 NOTE  that  this  will  not  work  if  the  subscriber  has  changed  addresses  as  the  mail  server  uses  the  ‘From’  address  to  attempt  an 
"unsubscribe". 
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• Installation  instructions  and  information  on  computer  system  requirements  will  be  included  in  a User 
Guide  with  the  KPIRS  software. 

• Since  the  KPIRS  reporting  software  is  populated  with  information  taken  from  other  sources,  the 
accuracy  of  KPI  data  and  the  integrity  of  reporting  processes  depend  on  the  appropriate  use  of  each 
of  the  other  sources. 

• Program  and  enrolment  information  can  only  be  submitted  through  CIS.  (Institutions  will,  however, 
be  able  to  adjust  data  for  student  contact  hours  for  the  Faculty  Load  indicator  through  KPIRS.)  Any 
changes  to  program  and  enrolment  information  must  be  made  through  CIS.  Thus,  institutions  must 
ensure  that  their  CIS  submission  is  prompt,  complete,  and  accurate. 

• Revenue  and  expenditure  information  can  only  be  submitted  through  FIRS.  Any  changes  to  this 
information  must  be  made  through  FIRS. 

• It  is  not  necessary  to  wait  until  all  data  is  ready  before  submitting  the  diskettes  to  the  department. 


Future  Development  of  KPIs 

Even  though  KPI  reporting  is  relatively  new  it  has  become  quite  routine  and  the  KPI  Manual  and  the 
software  are  mostly  undergoing  fine-tuning.  On  the  other  hand,  work  still  needs  to  be  done  to  give  a 
higher  level  of  confidence  in  the  system-wide  comparability  of  some  data.  There  is  also  a constant  need 
to  ensure  that  the  data  being  collected  is  used  and  that  it  is  able  to  provide  the  indicators  that  the  system 
can  use.  In  that  context,  a new  system-wide  KPI  Policy  Committee  has  been  created,  with  representation 
from  each  sector  (universities,  private  university  colleges,  and  colleges),  from  students,  and  from  the 
department.  The  committee’s  first  and  second  meetings  were  held  on  September  25  and  November  25, 
1998.  Information  on  the  committee’s  work  can  be  obtained  from  either  the  System  Information  Branch 
or  from  the  Assistant  Deputy  Minister,  Learning  Support  and  Accountability.  The  Chair  of  the 
Committee  is  Dr.  Seamus  O’Shea,  Vice-President  Academic,  University  of  Lethbridge. 

The  terms  of  reference  for  the  committee  follow: 


• Responsibilities 

The  committee  will  provide  broad  advice  to  the  system  - AECD  and  the  institutions  - on  the 
development  of  KPIs  that  will  meet  the  information  needs  of  the  entire  system.  The  committee  will 
strive  to  ensure  that  KPIs  will  be  consistent  and  comparable  at  a program  level  across  sectors  and 
institutions.  Specifically,  the  committee  will 

• recommend  the  KPIs  that  are  to  be  used;  this  will  include  recommendations  on  replacing  or 
improving  existing  KPIs; 

• ensure  that  standard  definitions  and  methodologies  are  used  so  as  to  ensure  consistency  and 
comparability; 

• ensure  that  communication  about  all  aspects  of  KPI  development  and  use  is  clear  among  the 
institutions  and  between  the  institutions  and  the  department;  and 

• advise  AECD  and  institutions  regarding  systems  and  support  for  KPI  data  collection, 
maintenance  and  distribution. 


• Membership 

Universities 


Four  members 


Colleges  and  Technical  Institutes  Six  members 


Private  University  Colleges  One  member 

Students  Two  members  (One  from  each  of  ACTISEC  and  CAUS.) 


Advanced  Education  and  Career  Two  members: 

Development  ADM,  Learning  Support  and  Accountability 

Director,  System  Information  Branch 
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• Committee  Operations 

The  work  of  the  committee  is  steered  by  an  agenda  committee  that  will  be  struck  by  the  entire 

committee. 

The  committee  names  a chair  annually.  It  is  expected  that  the  chair  will  rotate  among  the  sectors. 

Meetings  of  the  agenda  committee  are  convened  and  Chaired  by  the  department  (Director,  System 
Information  Branch). 

• Secretariat  Support 

Support  is  provided  by  the  System  Information  Branch  of  Advanced  Education  and  Career 
Development.  (Appropriate  officials  or  consultants  needed  to  carry  out  the  Committee’s  work  will 
attend,  as  required  by  the  agenda.) 

• Frequency  of  Meetings 

The  committee  will  normally  meet  four  times  a year;  the  agenda  committee,  as  often  as  necessary  to 
facilitate  the  work  of  the  committee. 

The  committee  will  form  working  groups  for  specific  tasks,  and  will  undertake  some  work  using  a 
listserver  and  conference  calls. 

Auditing  data 

It  is  Imperative  that  revenue  and  expenditure  data  submitted  through  FIRS  be  reconcilable  with  the 
audited  financial  statements.  CIS  data  is  carefully  checked  by  department  staff  and  the  enrolment  data  is 
subject  to  audit  by  the  provincial  Auditor  General.  KPI  data  - in  particular,  that  used  in  performance- 
based  funding  - is  reviewed  by  the  Auditor  General  to  ensure  compliance  with  reporting  methodologies 
and  protocols  through  a specified  procedures  audit.  Audit  observations  and  recommendations  are  made 
to  the  institutions  subject  to  audit,  and  to  the  department.  Institutions  should  take  some  care  in 
undertaking  their  KPI  work  to  ensure  that  procedures  are  documented  so  as  to  facilitate  the  audit  process. 
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KPI  CONTACTS 


f Colleges 

Mr.  Eric  Feciiter 

Mr.  Ismal  Sutankayo 

Vice-President 

Director,  Financial  Affairs 

Alberta  College  of  Art  and  Design 

Fairview  College 

1407  - 14  Avenue  N.W. 

Box  3000 

Calgary,  Alberta  T2N  4R3 

Fairview,  Alberta  T0H  1L0 

Phone:  284-7639 

Phone:  835-6657 

Fax:  289-6682 

Fax:  835-6698 

e-mail:  eric.fechter@acad.ab.ca 

e-mail:  isutankayo@fairviewc.ab.ca 

Mr.  Bob  Lea 

Mr.  Alan  Vladicka 

Government  Reporting  Officer 

Coordinator,  Institutional  Research 

Grande  Prairie  Regional  College 

Grant  MacEwan  Community  College 

10726-106  Avenue 

Box  1796 

Grande  Prairie,  Alberta  T8V  4C4 

Edmonton,  Alberta  T5J  2P2 

Phone:  539-2097 

Phone:  497-5391 

Fax:  539-2888 

Fax:  497-5405 

email:  bob.lea@gprc.ab.ca 

e-mail:  vladickaa@admin.gmcc.ab.ca 

Mr.  Bryan  Husband 

Mr.  Garry  Garton 

Director,  Research  & Planning 

Manager  of  Institutional  Planning  & Research 

Keyano  College 

Lakeland  College 

8115  Franklin  Avenue 

Bag  5100 

Fort  McMurray,  Alberta  T9H  2H7 

Vermilion,  Alberta  T0B  4M0 

Phone:  791-4852 

Phone:  853-8610 

Fax:  791-4868 

Fax:  853-8601 

e-mail:  bryan.husband@keyanoc.ab.ca 

e-mail:  garry.garton@lakelandc.ab.ca 

Dr.  Leslie  Vaala 

Mr.  Dave  Jones 

Director 

Vice-President,  College  Services 

Institutional  Planning  & Reporting  Services 

Medicine  Hat  College 

Lethbridge  Community  College 

299  College  Drive  S.E. 

3000  College  Drive  South 

Medicine  Hat,  Alberta  T1A  3Y6 

Lethbridge,  Alberta  T1K1L6 

Phone:  529-3803 

Phone:  320-3268 

Fax:  526-7750 

Fax:  329-0530 

e-mail:  dwjones@acd.mhc.ab.ca 

e-mail:  Idvaala  @raptor.lethbridgec.ab.ca 

Ms.  Lynda  Wallace-Hulecki 

Ms.  Sandy  Wilson 

Director,  Institutional  Analysis  and  Planning 

Project  Coordinator 

Mount  Royal  College 

Olds  College 

4825  Richard  Road  S.W. 

4500  - 50  Street 

Calgary,  Alberta  T3E  6K6 

Olds,  Alberta  T4H  1R6 

Phone:240-6396 

Phone:  556-4757 

Fax:  240-6040 

Fax:  556-4698 

e-mail:  lhulecki@mtroyal.ab.ca 

e-mail:  swiIson@admin.oldscollege.ab.ca 
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Mr.  Tony  Skoijanc 
Institutional  Research  Officer 
Red  Deer  College 
Box  5005 

Red  Deer,  Alberta  T4N  5H5 
Phone:  343-4066 
Fax:  341-4899 

e-mail:  tony. skoijanc  @rdc.ab.ca 


1 Technical  Institutes 

Mr.  Bill  Spaans 

Vice-President 

Student  Services  & Community  Relations 

Northern  Alberta  Institute  of  Technology 
11762-106  Street 

Edmonton,  Alberta  T5G  2R1 

Phone:471-7008 

Fax:  471-8583 
e-mail:  bills  @nait.ab.ca 

^ ^ ^ - 

Mr.  Chi-Fui  Chong 

Controller 

Southern  Alberta  Institute  of  Technology 

1301  - 16  Avenue  N.W. 

Calgary,  Alberta  T2M0L4 

Phone:  284-8142 

Fax:  284-8158 

e-mail:  chifui.chong@sait.ab.ca 

1 Alberta  Vocational  Colleges 

Mrs.  Ethel  Laslo 

: 1 

Mr.  Wally  Tichonuk 

Budget  Coordinator 

Director,  Finance  & Administration 

Alberta  Vocational  College  - Edmonton 

Alberta  Vocational  College  - Lac  La  Biche 

10215  - 108  Street 

9531  - 94  Avenue 

Edmonton,  Alberta  T5J  1L6 

Lac  La  Biche,  Alberta  TO  A 2C0 

Phone:  427-7592 

Phone:  623-5639 

Fax:  427-5484 

Fax:  623-5665 

e-mail:  ethel.laslo@avc.ab.ca 

e-mail:  wally.tichonuk@ avcllb.ges.ab.ca 

Ms.  Monica  Kreiner 

Mr.  Peter  Johnson 

Performance  Measures  Coordinator 

Dean,  Student  & Ancillary  Services 

Alberta  Vocational  College  - Lesser  Slave  Lake 

Bow  Valley  College 

Grouard  Campus,  Bag  3000 

332-6  Avenue  S.E. 

Slave  Lake,  Alberta  TOG  ICO 

Calgary,  Alberta  T2G4S6 

Phone:  849-8617 

Phone:  297-4085 

Fax:  849-2570 

Fax:  297-4847 

e-mail:  witte @grda.avc.calgary.ab.ca 

r • - K /vrt - 

e-mail:  pjohnson@bowvalleyc.ab.ca 

* • — | 

I universities 

Mr.  Rick  Powell 

' 1 

Dr.  Carl  Betke 

Head,  Institutional  Analysis 

Director,  Strategic  Analysis 

Athabasca  University 

University  of  Alberta 

Box  10,000 

1-16  University  Hall 

Athabasca,  Alberta  T9S  1A1 

Edmonton,  Alberta  T6G  2J9 

Phone:  675-6220 

Phone:  492-9063 

Fax:  675-6170 

Fax:  492-1439 

e-mail:  rick@athabascau.ca 

e-mail:  carl.betke@ualberta.ca 
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Dr.  Doug  Shale 

Academic  Analyst 

Office  of  Institutional  Analysis 

Room  1017  Education  Tower 

University  of  Calgary 

2500  University  Drive  N.W. 

Calgary,  Alberta  T2N  1N4 
Phone:  220-4016 
Fax:  282-7221 
e-mail:  dshale@ucalgary.ca 

1 Private  University  Colleges 

Dr.  David  W.  Dahle 
Interim  Academic  Dean 
& Vice-President  for  Academic  Affairs 
Augustana  University  College 
4901  - 46  Avenue 
Camrose,  Alberta  T4V  2R3 
Phone:  679-1102 
Fax:  679-1129 

e-mail:  dahld@corelli.augustana.ab.ca 


Dr.  Dennis  W.  Domoney 
Director,  Institutional  Analysis 
University  of  Lethbridge 
4401  University  Drive 
Lethbridge,  Alberta  T1K3M4 
Phone:  329-2062 
Fax:  329-2097 
e-mail:  domodw@hg.uleth.ca 


Dr.  Richard  Kraemer 
President 

Concordia  University  College  of  Alberta 
7128  Ada  Boulevard 
Edmonton,  Alberta  T5B  4E4 
Phone:  479-8481 
Fax:  474-1933 

e-mail:  rkraemer@concordia.ab.ca 


Mr.  Merton  Sprengel 

Dr.  Keith  Ward 

Statistician 

Vice-President 

Canadian  Union  College 

The  King’s  University  College 

235  College  Avenue 

9125  - 50  Street 

College  Heights,  Alberta  T4L  2E5 

Edmonton,  Alberta  T6B  2H3 

Phone:  782-3381 

Phone:  465-3500 

Fax:  782-3170 

Fax:  465-3534 

e-mail:  msprenge@cauc.ab.ca 

e-mail:  skward@kingsu.ab.ca 

Ms.  Marilyn  Patton 

Executive  Officer 

Private  Colleges  Accreditation  Board 

Room  430,  108  Street  Building 

9942  - 48  Street 

Edmonton,  Alberta  T5K2J5 

Phone:  427-8921 

Fax:  427-0423 

e-mail:  marilyn.patton@aecd.gov.ab.ca 
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KPIRS:  An  Overview  of  its  Program  Classification  Structure  and 

Reporting  Levels 

Hie  program  classification  structure  in  KPIRS  is  extracted  from  the  CIS  program  classification.  This 
structure  provides  the  basis  for  entering  data  at  any  level  of  aggregation.  The  illustration  below  describes 
the  available  levels  of  reporting,  from  the  highest  - the  Institution  level  - to  the  more  detailed  Program 
level.  Institutions  are  expected  to  enter  their  KPI  data  at  the  appropriate  level,  as  defined  for  each 
Information  Set  in  this  Manual. 

REPORTING  LEVEL 


Institution  Level 

pi  Represents  the  institution  as  a whole;  may  be  a sum  or  roll-up  of  data  entered  at  one  of  the  more 
v detailed  levels  described  below. 

Faculty  / Administrative  Unit 

Usually  the  first  level  of  organizational  classification  below  the  'Institution”  level.  What  is 
4>  called  "division”  at  one  institution  may  be  called  “department”  or  “faculty”  at  another.  This  is 
the  unit  charged  with  administrative  responsibility  for  the  Program. 

KPI  Program  Type  (See  Table  1 for  details  of  Program  Types) 

A set  of  classifications  that  group  programs  by  the  level  and  type  of  credential  awarded, 

43-  Certificate,  Diploma,  Degree,  etc.,  based  on  CIS  Standard  Name,  AECD  Program  Type, 
Program  Classification  and  Resulting  Qualification  data 

Subject  Area  (See  Table  2 for  details  of  Subject  Areas) 

pi  A grouping  of  programs  by  the  content  of  study  using  the  CIS  3-digit  Program  Classification 
v and  Standard  Name  data. 

Standard  Name 

n The  name  of  a “program”,  standardized  across  the  province  to  refer  to  similar  programs  that  have 
43-  differing  names  from  institution  to  institution,  e.g.,  Office  Administration  covers  Secretarial 
Science,  Clerk  Typist,  Administrative  Assistant,  Executive  Office  Assistant  and  others. 

Standard  Name  is  used  with  Program  Length  to  group  similar  programs,  and  is  the  basic 
“program”  level  used  for  KPI  reporting  for  the  universities,  private  colleges,  and  vocational 
colleges. 


Cross-Reference  Identifier  (XreflD) 

n Used  to  identify  programs  in  cases  where  the  “program”  has  more  than  one  ProgID.  Separate 
43-  ProgIDs  may  refer  to  separate  streams,  majors,  versions,  years  or  types  of  delivery  of  one 
program. 

Program  (ProgID) 

“Program”  corresponds  to  the  CIS  ProgID  level  used  for  enrolment  reporting.  The  ProgID  is 
the  basic  “program”  level  for  KPI  reporting  by  the  Colleges  and  Technical  Institutes. 


Program  Length 

Indicates  the  program  length  in  years  of  required  study. 
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Table  1:  CIS  Coding  to  Produce  KPI  Program  Type  Classifications 


KPI  Program  Type 

Parchment 

1997-98 

Type  or  Level  of  Qualification 

PU 

Preparatory  & Basic  Upgrading 

na 

[Qualif  = (10  OR  1 1 OR  12  OR  19  OR  21  or  31  or  32)  AND 
(Class.  Code  >=  700000  AND  <720000)]  j 

SK 

Skill  Training*  (Short) 

Certificate  / na 

[Qualif  = (10  OR  1 1 OR  12  OR  24  OR  29)  AND  (Class  Code 
<700000)] 

TC 

Trade  Certificate 

Certificate 

[Qualif  = 13  & AECD  Type  = TC] 

AP 

Apprenticeship 

na 

[Qualif  = 18] 

C 

Certificate 

Certificate 

[Qualif  = (13  OR  23  OR  29)  & AECD  Type  NOT  TC] 

D 

Diploma 

Diploma 

[Qualif  =14  OR  15] 

OC 

Other  Career  [Post-Certificate] 

Diploma 

[Qualif  = 16  OR  22] 

UT 

University  Transfer 

na 

[Qualif  = 20] 

AD 

Applied  Degree 

Degree 

[Qualif  = 43] 

UG 

Bachelor  Degree 

Degree 

[Qualif  = 41,42,  44,  45] 

MS 

Masters  Degree 

Degree 

[Qualif  = 51  OR  52  OR  53  OR  54] 

PD 

PhD 

Degree 

[Qualif  = 55] 

GS 

General  Studies 

na 

[((Qualif  =10  AND  Class  Code  >=720000)  OR  (Standard  Name  = 
Unclassified  OR  Graduate  - Qualifying  OR  Graduate  - Unclassified 
OR  Graduate  - Probationary)] 

* Includes  short  trade,  pre-emp,  JU,  other  skill  training;  only  Qualif=24  are  “parchment” . 

Note:  “Parchment  1997-98”  are  the  programs  that  make  up  the  parchment  set  for  97-98  KPI  reporting. 


Table  2:  CIS  Coding  to  Produce  Subject  Area  Classifications 


Subject  Area  CIS  3-Digit  Program  Class  Codes 


AE 

Architecture  and  Environmental  Design 

121,  126 

AG 

Agricultural  (and  related) 

230-237 

AS 

Arts  and  Science  (General) 

700.  720.  722.  723.  725.  730 

BL 

Biological  and  Other  Life  Sciences  Related 

200.  220-229,  240-243, 

BU 

Business  (and  related) 

600-625  (NOT  61 5) 

CM 

Communications  (and  related) 

510-514.  516 

ED 

Education  (and  related) 

310-312.  420-426 

FP 

Fine  and  Performing  Arts 

520-528 

HE 

Health  Related  (Not  Incl.  MD) 

300.  314.  330-334.  340-344.  360-363 

HS 

Humanities  and  Social  Sciences 

400-416.  500.  530-539.  721 

IT 

Information  Technology 

113.  515.  640-642 

MD 

Medicine  and  Dentistry 

320-328.  350-354 

MP 

Math  and  Physical  Sciences 

111-112.  115-117 

RR 

Renewable  Resources 

210-214 

SC 

Science  (General) 

100-110 

SH 

Services  and  Hospitality 

313,  615.630,  631.  633-637 

SS 

Social  and  Community  Services 

430-434.  440-444 

CE 

Civil  (engineering  and  related) 

120.122-125.  127  (NOT  121.126) 

CR 

Chemical  and  Resources  Related 

130-134 

EE 

Electrical  and  Electronics  (engineering  and  related) 

140-145 

EG 

Engineering  General  (and  related) 

160-163 

ME 

Mechanical  (engineering  and  related) 

150-154 

TR 

Transport  (and  Related) 

155.  156.632 

AC 

Academic  Upgrading 

710.  713 

CP 

College/University  Preparation 

715 

ES 

English  as  a Second  Language 

712 

JL 

Job  and  Life  Skills  Training 

711 

VP 

Vocational  Preparation 

714 

UC 

Unclassified 

724 
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KPI  Data  from  the  Common  Information  System  (CIS) 


The  Role  of  CIS  in  KPI  Reporting 

CIS  Student  Data  is  the  source  for  all  or  part  of  the  data  elements  in  the  following  KPI  Information  Sets: 
Access,  Program  Completion,  Transfer  Student  Performance,  Graduating  Student  Satisfaction,  Graduate 
Employment  and  Academic  Outcomes,  Demand  and  Capacity,  Program  Costs,  and  Cost  per  Graduate. 
The  Program  Classification  structure  (see  Page  16)  used  in  the  KPI  reporting  system  is  derived  from 
program  classification  features  used  in  CIS  Program  Data. 

Program  Level  Reporting  for  KPIs 

Several  KPI  Information  Sets  involve  reporting  data  at  a “program”  level.  Beside  CIS,  the  sources  for 
program  level  data  are  the  Alberta  Council  on  Admissions  and  Transfer  (AC AT)  and  the  institutions  [see 
illustration  on  Page  15].  In  CIS  the  basic  level  for  reporting  program  information  is  the  Program 
Identifier  (ProgID)  level.  At  an  institution  a ProgID  may  refer  to  an  entire  program  or  to  a single 
component,  stream  or  version  of  a program.  Examples  of  the  latter  are  co-op  streams,  alternative  Year  2 
majors,  common  first  year,  and  alternate  delivery  offerings. 

When  the  department  needs  to  publish  reports  using  data  presented  at  a higher  level  in  the  program 
structure,  such  as  Subject  Area  or  Program  Type,  the  data  is  generated  by  aggregating  the  ProgID  level 
data.  For  this  reason,  institutions  must  report  program  level  KPIs  at  the  CIS  ProgID  level.  (There  are 
exceptions  when  Standard  Name  is  used  for  the  program,  as  is  the  case  in  Preparatory  & Basic 
Upgrading,  and  University  Transfer,  for  example).  Universities  will  report  most  program  data  at  the 
Standard  Name  level  until  they  are  using  CIS.  Where  necessary,  institutions  should  pro-rate  higher  level 
data  to  make  allocations  at  the  ProgID  level. 

Common  Information  in  KPIRS 

A number  of  the  KPIs  use  “common”  data  extracted  or  calculated  from  the  CIS  Program  and  Student 
databases.  The  resulting  KPI  information  includes  unduplicated  headcounts,  FLEs,  Student  Contact 
Hours,  and  completer  counts  for  every  ProgID.  The  data  is  aggregated  and  stored  at  each  of  the  higher 
levels  in  the  program  classification  structure  and  is  available  as  needed  to  feed  into  other  KPI 
Information  Sets  or  to  be  provided  to  users. 

Completion  Data  for  Student  Tracking 

The  “Completion”  information  set  involves  identifying  an  entry  cohort  for  each  program  and  tracking 
students  until  they  complete  the  program  or  through  as  many  years  of  available  CIS  data  as  is 
appropriate.  This  is  a complex  procedure  that  uses  CIS  data  but  builds  a separate  data  system  to  manage 
the  tracking.  In  any  reporting  year,  completion  rate  data  will  be  generated  for  several  year’s  entry 
cohorts.  For  example,  in  2001-02  when  reporting  for  the  2000-01  reporting  year,  there  will  be  some  4- 
year  programs  with  a 94-95  entry  cohort  that  are  being  reported  for  the  final  time  after  seven  years  of 
tracking.  By  this  time  KPIRS  will  contain  a full  set  of  final  completion  rates  for  all  programs  that  had 
94-95  entry  cohorts. 
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Special  Situations  in  KPI  Reporting:  Use  of  CIS  in  Collecting  Information 

CIS  handles  enrolment  reporting  for  several  special  situations  : 

1 . Reporting  brokered  and  collaborative  programs 

2.  Reporting  alternative  delivery  offerings 

3.  Reporting  programs  with  a major  work  experience  component 

4.  Reporting  Unclassified  or  Non-Program  Students 

Guidelines  and  understandings  regarding  these  special  situations  are  provided  in  the  CIS  Reporting 
Manual.  The  current  version  of  this  document  is  available  on  the  AECD  website  at 
www . aecd.  gov . ab.  ca/ soft  ware  and  on  the  Department’s  FTP  (File  Transfer  Protocol)  site. 
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ACCESS  Indicators  (Enrolment  and  Instructional  Loads) 

Access  indicators  are  measures  of  student  participation  that  may  be  used  to  indicate  accessibility 
to  post-secondary  programs,  levels  of  service  provided  by  institutions  and  volumes  of 
instructional  activity: 

• full-time  student  annual  headcount  - credit  programs 

• part-time  student  annual  headcount  - credit  programs 

• full-load  equivalent  enrolment  - credit  programs 

• student  contact  hours  - credit  programs 

• annual  student  headcount  - non-credit  programming 

• course  and  program  registrations  - non-credit  programming 

• student  contact  hours  - non-credit  programming 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Access  - Credit  Programs 

Full-time  student  annual  headcount 

X 

X 

X 

Part-time  student  annual  headcount 

X 

X 

X 

Total  student  annual  headcount 

X 

X 

X 

Full  load  equivalent  enrolment 

X 

X 

X 

Student  contact  hours 

X 

- 

- 

Access  - Non-Credit  Courses  and  Programs 

Annual  student  headcount 

X 

X 

X 

Course  and  program  registrations 

X 

X 

X 

Student  contact  hours 

X 

X 

X 

Flexible  program  completers 

X 

X 

X 

Level  of  Reporting:  Enrolment  in  credit  programs  by  program  as  follows: 

Colleges  & Technical  Institutes  - at  CIS  ProgID  level. 

Vocational  Colleges  - at  CIS  Standard  Name  level. 

Universities  - at  CIS  Standard  Name  level,  by  program  length. 

Private  University  Colleges  - at  CIS  ProgID  level. 

Non-credit  annual  headcount  - at  the  institutional  level. 

Registrations  and  student  contact  hours  in  courses  and  programs  - at  a 
minimum  at  the  subject  area  level. 

Scope:  Information  required  for  all  credit  program  types:  Preparatory  & Basic 

Upgrading,  Skill  Training,  Trade  Certificate,  Apprenticeship,  Certificate, 
Diploma,  Other  Career  (Post-Certificate),  University  Transfer,  Applied 
Degree,  Bachelor  Degree,  Masters  Degree,  Ph.D.,  and  General  Studies. 
[See  Page  16]. 

Information  required  for  all  non-credit  programming  categories: 

Courses,  Flexible  Programs,  and  Programs. 
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Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Enrolment  in  Credit  Programs 

Program  identification  data 

CIS 

KPIRS  * 

CIS 

Full-time  student  annual  headcount 

CIS 

KPIRS  * 

CIS 

Part-time  student  annual  headcount 

CIS 

KPIRS  * 

CIS 

Total  student  annual  headcount 

CIS 

KPIRS  * 

CIS 

Full  load  equivalent  enrolment 

CIS 

KPIRS  * 

CIS 

Number  of  program  completers2 

CIS 

KPIRS* 

CIS 

Student  contact  hours  (CIS  proxy) 

CIS 

- 

- 

Student  contact  hours  (Institution  actual) 

CIS/KPIRS 

- 

- 

Enrolment  in  Non-Credit  Programs 

Annual  student  headcount  (Institutional) 

KPIRS 

KPIRS 

KPIRS 

Program  identification  data 

KPIRS 

KPIRS 

KPIRS 

Course  registrations 

KPIRS 

KPIRS 

KPIRS 

Student  contact  hours 

KPIRS 

KPIRS 

KPIRS 

* The  University  of  Lethbridge  data  for  these  elements  will  be  drawn  from  CIS. 


Specifications  and  Reporting  Protocols: 

Credit  Programs 

Credit  programs  are  those  recognized  and  included  in  the  AECD  Common  Information  System  (CIS) 
program  file  as  acceptable  for  official  enrolment  reporting.  CIS  Reporting  Manual  includes  a detailed 
description  of  terms  and  conditions  to  differentiate  credit  from  non-credit  programs,  courses  and 
enrolments  and  should  be  used  as  a basis  for  credit  and  non-credit  categorization. 

The  credit  enrolment  data  required  for  Access  indicators  is  available  for  each  institution  through  CIS. 
This  data  will  be  extracted  from  CIS  and  transferred  to  the  KPI  Reporting  System  (KPIRS)  for  use  where 
credit  enrolment  data  are  required.  It  is  available  through  CIS  at  an  elemental  program  level  (CIS 
“ProgID”),  or  by  aggregation  to  the  Standard  Name  and  higher  levels. 

Full-time  student  annual  headcount  - For  KPI  purposes,  the  annual  unduplicated  headcount  of  full-time 
students  is  the  number  of  individual  students  who  have  been  counted  as  full-time  during  at  least  one 
session  of  the  academic  year.  A full-time  student  in  CIS  is  an  active  student  in  a Summer,  Fall, 

Winter  or  Spring  session  who  is  registered  in  that  session  for  at  least  30%  of  the  full  year  load  for  the 
program. 

Part-time  student  annual  headcount  - For  KPI  purposes,  the  annual  headcount  of  part-time  students  is 
an  unduplicated  headcount  of  students  enrolled  in  a reporting  year  who  have  not  been  counted  as  full- 
time during  at  least  one  session  of  the  year.  Effectively,  part-time  enrolment  will  be  equal  to  the  total 
headcount  of  individuals  served  during  the  year  less  the  full-time  headcount. 

Total  student  annual  headcount  - An  unduplicated  count  of  the  total  number  of  students  served  in  each 
program  during  a reporting  period. 

Unduplicated  headcounts  - at  successive  levels  of  aggregation  - Over  the  course  of  a reporting  year,  a 
substantive  number  of  students  may  enroll  in  more  than  one  program.  Accordingly,  totals  for 
aggregations  of  programs  arrived  at  by  the  simple  addition  of  program  totals  will  not  agree  with 


2 The  Number  of  Program  Completers  is  not  an  Access  Indicator  element.  It  is  required  for  Graduating  Student 
Satisfaction,  Graduate  Employment  and  Academic  Outcomes,  and  Cost  per  Graduate  (Program  Completer) 
indicator  calculations.  The  nature  of  CIS  and  KPIRS  are  such  that  this  data  element  is  best  captured  with  the 
Access  indicator  data. 


KPI  Reporting  Manual 


Page  20 


December  1998 


unduplicated  headcounts  produced  at  the  higher  levels  of  aggregation.  CIS  will  be  used  to  produce 
unduplicated  total  headcounts  at  the  institutional  and  other  levels  and  these  will  be  used  in  place  of 
totals  produced  by  simply  summing  the  program  headcounts. 

Full-load  equivalent  (FLE)  enrolment  - A unit  measure  of  enrolment  in  which  one  FLE  represents  one 
student  for  a standard  year  of  study  taking  a Full  Load.  A full  load  represents  the  number  of  units 
(credits,  contact  hours  or  some  other  units)  of  load  required  to  complete  the  requirements  for  a 
standard  year  of  study  (typically  September  through  April)  in  a specific  program.  (For  further  detail, 
see  the  CIS  Reporting  Manual.)  CIS  generates  this  data  element  for  each  student’s  program  and  these 
are  aggregated  to  the  ProgID  level  for  use  in  KPIRS. 

Student  contact  hours  - SCH-  (Credit  Programs ) - The  sum  of  contact  hours  per  student  per  week 
times  the  number  of  weeks  in  a session  for  each  student  enrolled  in  a reporting  period.  Contact  hours 
are  the  actual  periods  of  time  (measured  in  hours  and  portions  thereof)  during  which  classes  or 
sections  of  students  are  engaged  in  scheduled  periods  of  lecture,  laboratory  and/or  tutorial  activities, 
and  an  instructor  or  instructors  are  present. 

CIS  permits  program  load  information  to  be  expressed  in  contact  hours,  credits  or  equivalent  units. 
Colleges  and  Technical  Institutes  may  use  credits  or  contact  hours  as  per  CIS  definitions  and 
guidelines.  Instructional  load  information  can  be  derived  from  program  load  data  but  is  only  a proxy 
for  the  actual  hours  that  students  are  scheduled  in  classes,  labs,  seminars  and  work  experience.  Where 
the  proxy  calculations  is  not  adequate  to  represent  students’  actual  hours  of  scheduled  learning 
activities.  Colleges  and  Technical  Institutes  may  do  their  own  calculations  and  enter  the  results 
directly  in  the  Student  Contact  Hours  section  of  the  Access  Information  Set. 

CIS  has  been  changed  for  1997-98  reporting  to  enable  institutions  to  report  the  actual  contact  hours 
needed  for  KPI  purposes.  Meanwhile,  a proxy  for  actual  SCH  can  still  be  calculated  from  CIS  student 
data.  The  proxy  is  calculated  as  Number  of  Weeks  times  Credits  or  Hours  and  will  be  best  suited  to  3 
credit  courses  in  programs  that  do  not  involve  labs,  etc. 

Contact  hour  equivalents  for  instructional  modes  and/or  settings  where  SCHs  would  not  be 
determined  on  a systematic  basis  need  to  be  dealt  with  as  exceptions.  The  following  guidelines, 
designed  to  take  into  account  the  different  intensities  of  Involvement  of  instructional  staff  (faculty- 
student  contact),  should  be  used  for  such  modes  and  settings: 

Practicum  - The  term  “practicum”  applies  to  a broad  range  of  learning  settings  and  experiences, 
ranging  from  a volunteer  observation  experience  to  direct  Involvement  in  the  workplace  (e.g. 
community  agency,  radio  station,  theatre)  wherein  the  workplace  serves  as  the  classroom  and  students 
are  under  the  direct  supervision  of  staff  of  the  organization  or  agency,  and/or  instructors  in  the 
program.  Guideline  for  SCH  equivalence:  1 hour  of  practicum  = 0.25  contact  hours. 

[Note:  In  some  institutions  the  term  practicum  is  used  to  apply  to  a learning  experience  supervised  by 
college  staff  in  a college-operated  facility,  e.g.,  cooking  students  in  a college-run  cafeteria,  ECD 
students  in  a college-operated  daycare,  etc.  In  such  cases,  a higher  SCH  equivalency  may  be 
appropriate  with  a guideline  of  1 hour  of  practicum  = 0.33  contact  hours  suggested  as  a guideline.] 

Clinical  - Hie  term  “clinical”  is  most  often  used  to  Identity  learning  experiences  within  Health 
Sciences  programs,  or  other  similar  learning  experiences  where  students  are  directly  and  constantly 
supervised  due  to  the  nature  of  the  activities  and  the  risks  and/or  liabilities  involved  for  the  host 
organization  or  agency,  the  college,  students  and  clients.  The  clinical  setting  usually  involves  clearly 
specified  learning  objectives,  and  a very  clear  role  for  supervisors.  Instructors  and/or  preceptors  who 
work  very  closely  with  students  in  this  setting.  Guideline  for  SCH  equivalence:  1 hour  of  clinical 
experience  - 0.50  contact  hours. 

Field  work/ field  placement  - Field  work  or  field  placement  learning  experiences  may  be 
components  of  regularly  scheduled  classroom  experience  or  extensions  of  the  classroom. 
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differentiated  from  practicum  or  clinical  experiences  by  the  relatively  less  intensive  involvement  of 
college  staff.  Instructors  may  visit  the  field  setting  from  time  to  time,  but  their  supervision  is  indirect 
and  their  role  in  the  field  is  facilitative  and  advisory.  Guideline  for  SCH  equivalence:  1 hour  of  field 
work  =0.33  contact  hours.  See  Page  18  for  more  detail  regarding  the  use  of  CIS  in  reporting 
programs  with  a work  experience  component. 

Number  of  Program  Completers  ( Graduates ) - The  total  number  of  students  who  have  been  determined 
by  the  institution  to  have  completed  all  graduation  requirements  for  a program,  during  the  reporting 
year  for  which  data  is  being  reported  and  to  whom  the  institution  would  therefore  confer  a parchment 
where  a parchment  is  offered.  Data  for  the  number  of  program  completers  is  reported  through  CIS  by 
Colleges  and  Technical  Institutes  and  Private  University  Colleges.  Universities’  data  will  be  reported 
through  KPIRS  until  available  through  CIS.  The  term  “graduate”  has  the  same  meaning  as  “program 
completer”. 

Non-Credit  Programming 

A new  reporting  structure  has  been  accepted  for  implementation  during  1997-98  as  the  basis  for  reporting 
in  December  1998. 

This  new  structure  contains  three  (3)  mutually  exclusive  programming  categories:  courses,  flexible 
programs,  and  programs.  In  addition,  there  are  two  (2)  sub-categories  - one  for  customized  training  and 
one  for  programming  for  children. 

A new  data  element  - flexible  program  completers  - has  been  added  to  capture  the  amount  of  activity 
occurring  in  the  Flexible  Programs  category. 

Commencing  with  1997-98  data  (to  be  reported  in  January  of  1999),  reporting  is  on  the  basis  of  the 
following  specifications: 

Non-credit  students  annual  headcount  - The  total  number  of  students  (unduplicated  headcount) 

participating  in  programs  or  courses  not  recognized  for  credit  in  CIS  reporting,  for  all  sessions  in  the 
reporting  year.  Institutions  currently  unable  to  calculate  unduplicated  headcount  should  leave  this 
field  blank  in  KPIRS.  As  with  credit  reporting,  learning  activities  that  have  been  reported  by  another 
institution  through  a brokering  arrangement  should  not  be  included  in  the  headcount.  See  Page  18  on 
Brokered  Programs. 

Non-Credit  Course  - Organized  subject  matter  with  pre-determined  curriculum,  and  set  of  specified 
learning  outcomes  delivered  to  a learner  usually  over  a specified  period  of  time.  Within  institutions, 
courses  may  be  referred  to  by  other  labels,  such  as  seminars,  workshops,  etc.  The  label  is  not 
important  in  determining  whether  an  educational  offering  is  to  be  considered  a course.  For  KPI 
reporting  purposes,  any  offering  meeting  the  above  criteria  is  a course.  (Note:  GED  testing  sessions 
and  admission  information  sessions  do  not  meet  the  criteria  of  the  course  definition.  In  addition, 
conferences  that  do  not  have  specified  learning  outcomes  should  not  be  considered  courses). 

Customized  Training  - A course  or  program  in  which  the  curriculum  has  been  customized  to  meet  the 
specific  training  or  educational  needs  of  a business  or  agency.  These  courses  are  usually  not  open  to 
the  general  public.  For  administrative  purposes,  the  primary  relationship  is  between  the  institution 
and  the  client,  not  between  the  institution  and  an  individual  learner.  (Note:  The  access  indicators 
(registrations,  unduplicated  headcount,  and  student  contact  hours)  describe  the  students  taking  the 
customized  training  not  the  client  for  whom  the  training  was  designed). 

Flexible  Program  - A collection  of  courses  related  by  a common  purpose,  all  of  which  must  be 

successfully  completed  for  students  to  receive  certification.  For  reporting  purposes,  students  register 
in  courses  in  the  program,  not  in  the  program  itself. 

Non-Credit  Program  - A collection  of  courses  related  by  a common  purpose,  all  of  which  must  be 
successfully  completed  for  students  to  receive  certification  (if  any  is  conferred).  For  reporting 
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purposes,  students  register  in  the  given  program,  not  in  the  courses  that  comprise  it.  Some  programs 
may  also  be  completed  in  a flexible  manner.  However,  regardless  of  the  degree  of  flexibility,  if 
students  are  registered  in  programs  not  courses,  they  are  considered  to  be  part  of  the  program 
category,  not  the  flexible  program  category. 

Programming  for  Children  - All  courses  or  programs  designed  by  the  institution  to  be  offered  to 
individuals  under  18  years  of  age.  (Note:  The  access  indicators  in  this  category  are  not  intended  to 
represent  every  student  under  the  age  of  18.  While  it  is  possible  that  individuals  under  this  age  may 
be  enrolled  in  courses  or  programs  that  are  not  specifically  designed  for  children,  since  not  all 
institutions  collect  age  information  on  their  non-credit  registrants  (as  they  do  with  their  CIS 
registrants),  not  every  institution  would  have  the  capability  of  supplying  this  information). 

Non-credit  registrations  - The  total  number  of  registrations  in  courses  or  programs  not  recognized  for 
credit  in  CIS  reporting,  for  all  sessions  in  the  reporting  year.  A student  enrolled  in  a course  or 
program  which  is  subsequently  cancelled  should  not  be  counted.  A student  withdrawing  before  a 
course  or  program’s  withdrawal  date  should  not  be  included;  a student  withdrawing  after  the 
withdrawal  date  should  be  included.  Since  students  may  be  registered  in  more  than  one  course  or 
program  over  the  course  of  a year  at  a given  institution,  registration  counts  are  generally  higher  than 
unduplicated  headcounts. 

Student  contact  hours  (non-credit  programming)  - An  aggregation  of  the  product  of  the  number  of 
registrations,  the  number  of  weeks  and  the  number  of  contact  hours  per  week  in  each  course  or 
program  not  recognized  for  credit  in  CIS  reporting,  for  all  sessions  In  the  reporting  year.  In  courses  or 
programs  that  are  not  delivered  in  a traditional  format  (that  is,  not  in  a classroom  with  an  instructor 
present),  the  number  of  contact  hours  that  would  have  been  accumulated  had  the  course  been  offered 
in  the  traditional  manner  should  be  used  as  a proxy  for  actual  student  contact  hours. 

Flexible  Program  Completer  - An  individual  who  has  been  awarded  some  type  of  certification  (a 
certificate  or  certificate  of  achievement)  either  by  a particular  institution  or  by  a given  professional 
association  upon  completion  of  a flexible  program. 
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PROGRAM  COMPLETION 


Program  Completion  indicators  are  intended  to  show  whether  students  who  enter  as  full-time 
students  complete  their  programs  of  study  over  a reasonable  periods  of  time. 

For  Colleges  and  Technical  Institutes,  the  “program  completion  rate”  is  the  proportion  of  an 
entry  cohort,  expressed  as  a percentage,  who  complete  a one  year  or  shorter  program  within  two 
years,  or  a two  year  or  longer  program  within  three  years,  following  the  earliest  year  in  which  a 
student  with  a full  year  program  load  would  normally  be  expected  to  complete  the  program. 
Completion  rates  are  calculated  to  include  those  who  complete  the  program  entered  and  those 
who  transfer  to  and  complete  other  programs. 

For  Universities  and  Private  University  Colleges,  the  “program  completion  rate”  is  the 
proportion  of  students,  adjusted  for  freshmen  not  returning  in  the  year  following  entry,  who 
proceed  to  successfully  complete  an  undergraduate  degree  or  diploma  program  within  a period 
ending  three  years  after  the  earliest  year  in  which  a student  with  a full  annual  program  load 
would  normally  be  expected  to  complete  the  program.  Completion  rates  are  calculated  to 
include  those  who  complete  the  program  entered  and  those  who  transfer  to  and  complete  other 


programs. 

For  Preparatory  & Basic  Upgrading  programming  the  completion  indicator  is  constructed  as  a 
“course  completion  rate”  to  show  whether  PBU  students  complete  their  courses  of  study 
within  the  term  over  which  the  courses  of  study  are  offered.  The  PBU  completion  rate  is  the 
total  number  of  course  completions  expressed  as  a percentage  of  the  total  course  registrations 
for  any  program  area  in  any  reporting  year. 


Indicator(s)  Apply  to: 

Program  completion 
Course  completion 
Transfers  to  other  institutions 
Non -completers  still  active 
Graduate  to  FLE  enrolment  ratio 
# of  course  completions 


Colleges  Technical 
Institutes  : 

• : Universities 

Private  University 
Colleges 

X 

Except  AU 

X 

PBU  programming 

- 

- 

- 

Optional 

Optional 

X 

Optional 

Optional 

- 

AU  only 

- 

- 

AU  only 

- 

Leve!  of  Reporting:  Program  completion  information  is  required  by  program: 

Colleges  & Technical  Institutes  - at  CIS  ProgID  by  XrefID  level. 
Vocational  Colleges  - at  CIS  Standard  Name  level,  by  program  length. 
Universities  - at  CIS  Standard  Name  level,  by  program  length. 

Private  University  Colleges  - at  CIS  Standard  Name  level,  by 
program  length. 

Course  completion  data  is  required  for  Preparatory  & Basic  Upgrading 
(PBU)  program  areas  at  the  CIS  Standard  Name  level.  [See  Page  15]. 

Scope:  Information  required  for  the  following  parchment  program  types:  Skill 

Training,  Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post- 
Certificate),  Applied  Degree,  and  Bachelor  Degree.  [See  Page  16]. 
Graduate  programs  are  not  included. 
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Course  completion  information  is  required  for  Preparatory  & Basic 
Upgrading. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

CIS 

KPIRS  * 

CIS 

Entry  stream  {freshman/other} 

- 

KPIRS 

KPIRS 

Entry  year 

CIS 

KPIRS 

CIS 

Earliest  completion  year 

CIS 

KPIRS 

KPIRS 

Program  length 

CIS 

KPIRS 

CIS 

Entry  cohort 

CIS 

- 

- 

# of  completers  entry  program 

CIS 

- 

- 

# of  completers  other  programs 

CIS 

- 

- 

Program  completion  rate  -entry  program 

CIS 

- 

- 

Program  completion  rate  - total 

CIS 

- 

- 

Completion  cohort 

- 

KPIRS 

KPIRS 

# of  completers  entry  program 

- 

KPIRS 

KPIRS 

# of  completers  same  faculty 

- 

KPIRS 

- 

# of  completers  other  faculties 

- 

KPIRS 

- 

# of  completers  other  programs 

- 

- 

KPIRS 

Program  completion  rate  - entry  program 

- 

KPIRS 

KPIRS 

Program  completion  rate  - total 

- 

KPIRS 

KPIRS 

Transfers  to  other  institutions 

- 

KPIRS 

KPIRS 

Non-completers  still  active 

Athabasca  University 

■ 

KPIRS 

KPIRS 

FLE  enrolment 

- 

KPIRS  1 

- 

# of  graduates  (completers) 

- 

KPIRS  1 

- 

Graduate  to  FLE  enrolment  ratio 

- 

KPIRS  1 

- 

# of  course  completions 

- 

KPIRS  1 

- 

Preparatory  & Basic  Upgrading 

Program  area  (CIS  Standard  Name) 

CIS2 

- 

- 

Total  course  registrations 

KPIRS  2 

- 

- 

Total  course  completions 

KPIRS2 

- 

- 

Course  completion  rate 

KPIRS2 

- 

- 

1 Athabasca  University  only. 

2 PBU  programming  only. 

* The  University  of  Lethbridge  data  for  this  element  will  be  drawn  from  CIS. 


Specifications  & Reporting  Protocols: 

Entry  cohort  /entry  year  - A group  of  students  who  have  commenced  study  as  full-time  students 

(registered  in  the  entry  session  for  at  least  30%  of  the  normal  annual  load  for  the  program)  in  the  same 
program  during  the  same  time  period.  For  KPI  reporting  purposes  the  time  period  will  be  a year 
ending  June  30th  (an  “ Entry  Yeaf  ’).  For  Universities  and  Private  University  Colleges,  the  entry  cohort 
is  adjusted  for  students  who  transfer  between  programs  by  the  start  of  the  year  following  the  entry 
year. 
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For  Universities  & Private  University  Colleges 

Hie  methodology  for  this  indicator  involves  features  that  were  strongly  endorsed  by  the 
universities  when  the  indicators  were  being  developed.  But  these  features  introduced  a number  of 
complications/uncertainties  that  have  made  it  difficult  for  institutions  or  the  department  to  come 
up  with  consistent  specifications  and  to  write  a program  to  calculate  a program  level  completion 
rate.  Hie  various  approaches  taken  to  date  have  resulted  in  data  that  works  only  for  an  institution 
level  rate. 

The  two  features  are  (1)  the  entry  cohort  for  each  program  has  to  be  adjusted  to  allow  for  students 
who  transfer  out  or  in  at  some  point  before  the  end  of  the  year  following  the  entry  year;  and  (2) 
freshman  who  are  no  longer  attending  the  institution  during  the  entry  year+1  are  removed 
completely  from  any  entry  year  cohort  even  if  they  return  and  complete  the  program  within  the 
period  for  which  completions  are  being  counted. 

A methodology  that  will  produce  comparable  and  reliable  completion  rates  at  a program  level  is 
required.  The  department  is  working  with  the  universities  to  come  up  with  such  a methodology, 
preferably  one  closer  to  the  approach  used  in  other  sectors. 


Program  length  (y)  - The  intended  number  of  academic  years  required  for  a continuously  enrolled  full- 
time student  to  complete  all  requirements  for  a certificate,  diploma  or  degree.  Normally  1 year  for  a 
certificate  program,  2 years  for  a diploma  program,  and  4 years  for  a bachelor  degree. 

Entry  year  - see  Entry  cohort  / entry  year. 

Earliest  completion  year  - The  earliest  academic  year  during  which  a student  taking  frill  year  course 
loads  may  be  expected  to  complete  the  graduation  requirements  for  a certificate,  diploma  or  degree 
program.  For  a two  year  diploma  program,  the  earliest  completion  date  for  a substantial  number  of 
students  will  be  April  of  the  year  following  the  entry  year,  and  the  earliest  completion  year  will  be  the 
year  ending  June  30th  of  that  year.  For  a one  year  certificate  program,  the  earliest  completion  year  will 
be  the  same  year  as  the  entry  year.  For  a four  year  degree  program,  the  earliest  completion  year  will 
be  the  third  year  following  the  entry  year. 

Completion  cohort  freshmen  entry  stream /other  entry  stream  - (Universities  and  Private  University 
Colleges)  - Each  entry  cohort  is  subdivided  into  a “freshmen  entry  stream”  (students  who  are  new  to 
the  institution  at  entry  and  who  are  not  granted  transfer  or  advanced  credit  at  entry,  or  whose  last 
institution  attended  was  a high  school),  and  an  “other  entry  stream”  (all  other  entrants).  For  each 
program,  the  students  in  the  freshman  entry  stream  are  adjusted  for  those  not  returning  to  the 
institution  in  the  subsequent  year  mid  for  inter-program  transfers  to  constitute  the  “completion  cohort  - 
freshman  entry  stream”.  The  students  in  the  other  entry  stream  are  adjusted  for  transfers  to  constitute 
the  “completion  cohort  - other  entry  stream”. 

Completer  - Any  student  who  has  been  determined  by  the  institution  to  have  completed  all  graduation 
requirements  and  to  whom  the  institution  would  therefore  confer  a parchment  where  a parchment  is 
offered. 

# of  completers  - (Colleges  & Technical  Institutes)  - The  number  of  students  who  complete  graduation 

requirements  for  their  entry  program  (#  of  completers  entry  program ) or  some  other  program  (#  of 
completers  other  programs)  within  a period  ending  two  years  after  the  earliest  completion  year  for  a 
one  year  certificate  program  or  three  years  after  the  earliest  completion  year  for  a two  year  diploma  or 
an  applied  degree  program. 

# of  completers  - (Universities  and  Private  University  Colleges)  - The  number  of  students  from  the 

completion  cohort  who  complete  graduation  requirements  for  the  degree,  certificate  or  diploma  within 
a period  ending  three  years  after  the  earliest  completion  year  for  the  program.  For  a four  year  program 
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with  earliest  completion  in  1990-91 , completers  would  be  counted  to  June  30,  1993-94.  For  a two 
year  diploma  (entry  year  1987-88),  the  earliest  completion  year  would  be  1988-89,  with  completers 
counted  through  1991-92.  Completers  are  grouped  and  counted  for  each  entry  stream  (freshmen, 
other)  within  each  of  the  following  categories:  entry  program,  other  program  in  same  faculty, 
program  in  different  faculty. 

Program  completion  rate  - (Colleges  & Technical  Institutes)  - The  total  number  of  completers  for  a 
program,  expressed  as  a percentage  of  the  entry  cohort.  The  entry  (or  completion)  cohorts  may  be 
aggregated  up  to  the  institution  level,  along  with  the  total  number  of  completers.  Once  all  program- 
level  entry  or  completion  cohorts  have  been  tracked  for  the  appropriate  period,  an  institution-level 
completion  rate  can  be  calculated. 

Program  completion  rate  - (Universities  and  Private  University  Colleges)  - The  number  of  students 
from  a completion  cohort  (freshman  entry  stream,  other  entry  stream)  who  complete  graduation 
requirements  (including  application  to  graduate)  for  an  undergraduate  degree,  diploma  or  certificate 
during  the  completion  period  for  their  cohort  (i.e.,  before  the  end  of  the  third  year  following  the 
earliest  completion  year)  either  in  their  entry  program  or  in  some  other  program,  as  a percentage  of  the 
total  number  in  the  completion  cohort.  Once  all  program  level  entry  or  completion  cohorts  have  been 
tracked  for  the  appropriate  period,  an  institution  level  completion  rate  can  be  calculated. 

Transfers  to  other  institutions  freshmen  / other  - Significant  number  of  students  may  transfer  from  one 
institution  to  another  prior  to  completing  a program.  “Sending”  institutions  may  wish  to  identify,  at 
the  program  and/or  institutional  level,  the  numbers  of  transfers  to  another  institution.  This  can  be 
done  by  searching  the  Alberta  Council  on  Admission  and  Transfer  duplicate  application  detection 
project  (DAD)  database  for  non-completers  who  are  no  longer  active  at  the  institution  to  identify  the 
numbers  attending  another  institution  in  subsequent  years.  This  is  an  optional  data  element. 

Non-completers  still  active  - Some  institutions  may  wish  to  report,  by  program  and/or  at  the 
institutional  level,  the  number  of  students  who  are  still  actively  pursuing  a degree,  diploma  or 
certificate  at  the  end  of  the  period  over  which  completers  have  been  accumulated.  This  is  an  optional 
data  element. 

Graduate  to  FLE  enrolment  ratio  & # of  course  completions-  Athabasca  University  programs  and 
students  are  such  that  the  indicators,  formats,  methods  and  procedures  are  not  appropriate.  AU  will 
report  a “graduate  to  FLE  enrolment  ratio”  and  the  “number  of  course  completions”  at  a program 
level.  The  term  “graduate”  has  the  same  meaning  as  “program  completer”.  A “course  completer”  is  a 
student  who  has  achieved  the  course  objectives  and  received  credits  where  offered. 

Program  area  - The  broad  program  grouping  at  which  course  registrations  are  to  be  summarized  and 
reported  for  Preparatory  & Basic  Upgrading  programs.  The  program  area  will  correspond  to  the  CIS 
Standard  Name,  such  as  Adult  Literacy,  ABE,  ESL.  Some  institutions  may  deliver  these  as  non-credit 
offerings,  in  which  case  they  will  not  be  included. 

Total  course  registrations  - The  total  number  of  registrations  in  all  credit  course  offerings  in  the 
program  area  in  the  reporting  year. 

Total  course  completions  - The  number  of  successful  course  completions  resulting  from  the  total  course 
registrations  recorded  for  the  “program  area”.  A student  has  successfully  completed  a course  when 
he/she  has  achieved  the  course  objectives. 

Course  completion  rate  - The  ratio  of  total  completions  to  total  course  registrations  in  the  “program 
area”. 
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Generating  College  & Technical  Institutes'  Program  Completion  Elements  from  CIS  Data  - The 

following  steps  will  be  used  by  AECD  to  generate  program  completion  information  elements  from  CIS 

data: 

1 . Identify  programs  for  which  program  completion  rates  are  to  be  reported  and  classify  by  KPT 
Program  Type. 

2.  Classify  programs  by  program  length. 

3.  For  a given  entry  year,  establish  the  earliest  completion  year  for  each  program. 

4.  For  each  program  count  the  number  of  lull  -time  students  new  to  the  program  in  the  entry  year. 
Where  students  have  switched  or  transferred  between  programs  during  the  entry  year,  count  the 
student  in  the  last  program  of  entry.  This  is  the  “Entry  Cohort”. 

5.  For  each  program,  count  the  number  of  students  who  complete  graduation  requirements  for  the 
program  by  June  30m  of  the  earliest  completion  year  (column  1 in  the  following  table)  and,  count  the 
number  who  completed  requirements  for  any  other  diploma  or  certificate  during  the  same  period 
(column  6). 


Number  of  Completers  - Entry  Program 

Number  of  Completers  - Other  Programs 

by  June  30 

by  June  30 

by  June  30 

by  June  30 

Total 

by  June  30 

by  June  30 

by  June  30 

by  June  30 

Total 

(1) 

(2) 

(3) 

(4) 

—M 

ID 

(7) 

IS! 

, W 

—09 

Repeat  for  two  more  years  for  one  year  programs  and  three  more  years  for  two  year  mid  longer 
programs,  and  accumulate  the  results. 

7.  Add  numbers  of  completers  in  entry  programs  to  numbers  of  completers  in  other  programs  and  divide 
the  total  by  the  number  of  students  in  the  Entry  Cohort  to  produce  the  completion  rate  for  the 
program. 

8 . Repeat  for  each  program. 

Notes  re:  Colleges  & Technical  Institutes 

■ Students  who  entered  a cohort  as  full-time  students  and  whose  status  changes  to  part-time  will  remain  in  the 
cohort. 

■ Internal  transfer  students  (transferring  within  the  institution  to  another  “new”  program  in  a subsequent  year) 
will  remain  in  the  “entry”  cohort  of  the  earlier  year.  Completion  rates  will  be  reported  for  those  who 
completed  their  entry  program  and  for  those  who  completed  another  program.  Students  who  transfer  before 
June  30  of  their  year  of  entry  will  be  included  in  the  program  of  record  as  at  June  30  of  that  year. 

■ Institutions  with  significant  numbers  of  students  transferring  internally  or  externally  from  programs  other  than 
those  specified  for  University  Transfer  Program  Leaver  reporting  may  wish  to  provide  supplementary 
information  and/or  reference  notes. 


Generating  Universities  and  Private  University  Colleges  Program  Completion  Elements  from  CIS 
Data  The  following  steps  will  generate  program  completion  information  elements  from  CIS  data  when 
available,  and  should  be  applicable  to  local  databases  in  the  interim: 

1 . Identify  programs  at  the  CIS  Standard  Name  level  for  which  program  completion  rates  are  to  be 
reported  and  classify  by  faculty. 

2.  Classify  programs  by  program  length.  Where  a Standard  Name  classification  includes  separate 
programs  (at  the  CIS  ProgID  level)  of  different  lengths,  group  the  programs  based  on  length  and 
create  a separate  cohort  for  each  group. 
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3.  For  a given  entry  year  “x’\  establish  the  earliest  completion  year  “x+y-1”  for  each  program.  For 
December  1996  reporting  the  entry  year  1988-89  was  agreed  upon.  This  is  to  be  advanced  by  one 
year  in  each  subsequent  reporting  year. 

4.  Establish  an  entry  cohort  for  each  program  or  sub-program.  Identify  the  number  of  full-time 
undergraduate  students  new  to  the  program  in  the  entry  year  or  appearing  for  the  first  time  as  full- 
time students.  Exclude  unclassified,  visiting,  audit-only,  probationary  and  special  students. 

5.  Where  students  have  switched  or  transferred  between  programs  during  the  entry  year  or  between  the 
entry  year  and  their  second  year,  remove  them  from  their  original  entry  cohort  and  add  them  to  the 
entry  cohort  (same  stream)  for  their  “new”  program  (as  if  they  had  entered  that  program  at  the 
outset).  Exclude  any  internal  transfers  who  were  in  the  entry  year  of  a cohort  in  a prior  year  since 
they  will  have  been  “reclassified”  in  this  way. 

6.  Remove  any  freshman  students  who  are  not  continuing  in  the  institution  in  the  Fall  after  the  entry 
year. 

7.  Subdivide  the  entry  cohort  into  a freshmen  entry  stream  and  an  “other  (than  freshmen)”  entry  stream. 
These  are  the  “Completion  Cohorts”. 

8.  Check  to  ensure  that  no  student  is  in  two  entry  cohorts  of  the  same  year. 

9.  For  each  cohort,  identify  the  students  who  completed  graduation  requirements  for  any  undergraduate 
degree,  diploma  or  certificate  during  the  period  ending  three  years  after  the  earliest  completion  year. 
Group  and  count  the  completers  in  three  categories  - completing  the  same  program,  completing  a 
different  program  in  the  same  faculty,  or  finishing  any  other  program. 

10.  Aggregate  the  results  from  step  9. 

1 1 . Divide  the  total  number  of  completers  by  the  number  of  students  in  the  Completion  Cohort  to 
produce  the  completion  rate  for  each  program  or  program  sub-group. 

Note  re:  Cooperative  Programs  - The  cooperative  program  model  and  similar  delivery  arrangements  can 
introduce  periods  of  up  to  a year  (or  more)  during  which  normal  academic  study  is  interrupted,  with  the 
effect  that  earliest  completion  year  for  students  in  the  “co-op”  offering  of  a program  will  be  later  than  for 
students  in  the  regular  program.  In  such  cases,  the  offering  should  be  defined  as  a separate  program  with 
the  program  length  and  earliest  completion  year  based  on  the  particular  structure  and  characteristics  of 
the  program. 


Generating  course  completion  rates  for  Preparatory  & Basic  Upgrading  programs : - The  following 
table  will  assist  institutions  in  generating  the  data  to  be  reported  through  KPIRS  for  the  course 
completion  rate  by  subject  area.  It  illustrates  how  course  registrations,  course  completions  and  course 
completion  rates  can  be  aggregated  by  Standard  Name  and  the  results  entered  through  KPIRS. 


Courses  grouped  by 
Standard  Name 

Term 

Course 

Registrations 

Course 

Completions 

Course  Ccnpletion  Rate 

Standard  Name  1,  e.g.  Adult  Literacy 

Course  1 

Course  2 

Course  ...  etc. 

Total  SN1,  e.g.  AL 

to  KPIRS  screen 

to  KPIRS  screen 

calculated  by  KPIRS 

Standard  Name  2,  e.g.  Adult  Basic  Education 

Course  1 

Course  2 

Course  ...  etc. 

Total  SN2,  e.g.  ABE 

to  KPIRS  screen 

to  KPIRS  screen 

calculated  by  KPIRS 
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Notes  re:  Course  Completion 

■ Completion  rates  will  be  generated  at  the  Standard  Name  level  as  defined  in  CIS  for  each  institution. 

■ Students  who  have  remained  in  the  course  past  the  institutions’  own  deadline  for  withdrawal  without  academic 
penalty  are  considered  active  in  the  course  and  their  registration  is  to  be  counted. 

■ The  sum  of  all  active  course  registrations  should  be  entered  in  Total  Course  Registrations. 

■ The  sum  of  all  active  course  registrations  resulting  in  a successful  completion  should  be  entered  in  Total 
Course  Completions.  A student  has  successfully  completed  a course  when  he/she  has  achieved  the  course 
objectives. 
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FRESHMAN  STUDENT  PERSISTENCE 


These  indicators  are  measures  of  persistence  for  students  new  to  the  first  year  of  undergraduate 
programs  at  a university  or  a private  college.  Attrition  between  September  30  and  December  1 
is  determined  and  a first  session  retention  rate  calculated.  The  number  of  students  returning  in 
the  following  year  is  determined  and  first-to-second  year  retention  rate  is  calculated.  First  year 
leavers  are  categorized  as  those  required  to  withdraw,  those  who  transferred  to  other  Alberta 
post-secondary  institutions,  and  others  not  returning. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Retention  Rate  - Sept,  to  December 

_ 

except  AU 

X 

Retention  Rate  - Year  to  Year 

Freshmen  not  returning: 

- 

except  AU 

X 

% required  to  withdraw 

- 

except  AU 

X 

% transferring  to  other  Alberta  PSIs 

- 

except  AU 

X 

% other 

HHnsHnni 

except  AU 

X 

Level  of  Reporting:  Credit  programs  at  CIS  Standard  Name  level,  by  program  length.  [See 

Page  15] 

Scope:  Information  required  for  programs  in  which  cohorts  of  freshmen 

commence  study  toward  an  undergraduate  degree,  diploma  or  certificate. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Entry  program  identification  data 

_ 

KPIRS 

KPIRS 

# of  freshman  students: 

Enrolled  full-time  at  Sept.  30  (Year  x) 

- 

KPIRS 

KPIRS 

Enrolled  full-time  or  part-time  Dec.  1 (Yr  x) 

- 

KPIRS 

KPIRS 

Attrition  September  to  December 

- 

KPIRS 

KPIRS 

Retention  rate  - September  to  December 

- 

KPIRS 

KPIRS 

# enrolled  full-time  December  1 (Year  x) 

- 

KPIRS 

KPIRS 

# enrolled  full-time  or  part-time  December  1 

(Year  x+1) 

- 

KPIRS 

KPIRS 

Retention  rate  - Year  to  Year 

- 

KPIRS 

KPIRS 

# of  full-time  freshman  students  December  1 
(Year  x)  who  did  not  return  for  the 
following  Fall  session: 

# required  to  withdraw 

- 

KPIRS 

KPIRS 

% of  total  not  returning 

- 

KPIRS 

KPIRS 

# of  transfers  to  AB  PSIs 

- 

KPIRS 

KPIRS 

% of  total  not  returning 

- 

KPIRS 

KPIRS 

# of  others  not  returning 

- 

KPIRS 

KPIRS 

% of  total  not  returning 

- 

KPIRS 

KPIRS 

Total  not  returning 

- 

KPIRS 

KPIRS 
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Note  re:  CIS  as  a Data  Source:  With  one  exception,  the  data  elements  required  for  Freshman 
Persistence  calculations  are  available  through  the  AECD  Common  Information  System  (CIS).  The 
exception  is  the  “#  of  full-time  students  registered  at  September  30  (year  x)”.  For  CIS  to  be  used  to 
generate  Freshman  Persistence  Indicator  data,  institutions  will  need  to  supply  either  a listing  of  students 
who  are  active  full-time  students  as  of  September  30th,  or  a listing  of  the  full-time  students  who  were 
registered  on  September  30th,  but  not  enrolled  as  active  students  on  December  1st.  Otherwise,  institutions 
will  need  to  generate  freshman  persistence  indicator  data  from  institutional  records. 


Specifications  & Protocols: 

Entry  program  - The  program,  classified  by  faculty  for  universities,  in  which  a cohort  of  freshmen 
commence  study  toward  an  undergraduate  degree,  diploma  or  certificate. 

# of  freshmen  students  enrolled  full-time  at  September  3(fh  (Yearx)  - Full-time  students  who  are  new  to 

an  institution  at  entry  and  who  are  not  granted  transfer  or  advanced  credit  on  entry,  or  whose  last 
institution  attended  was  a high  school.  Using  CIS  definitions  a full-time  student  is  a student  carrying 
the  equivalent  of  30%  or  more  of  the  actual  full-year  load  for  the  program. 

# of  freshmen  students  enrolled  full-time  or  part-time  December  1 (yearx)  - The  number  of  freshmen 

students  who  were  enrolled  as  full-time  students  in  a credit  program  on  September  30  (or  an  earlier 
date  at  which  the  number  of  freshmen  commencing  a program  can  be  reasonably  determined)  and  who 
were  still  enrolled,  either  full-time  or  part-time,  on  December  1st  of  the  same  year. 

Attrition  - The  number  of  freshman  students  who  were  enrolled  as  full-time  students  in  a credit  program 
on  September  30  (or  an  earlier  date  at  which  the  number  of  freshmen  commencing  a program  can  be 
reasonably  determined),  minus  the  number  who  were  still  enrolled,  either  full-time  or  part-time,  on 
December  1st  of  the  same  year. 

Retention  rate  - September  to  December  - The  proportion  of  full-time  students  commencing  a program 
as  of  September  30th  who  are  still  active  at  the  institution,  full-time  or  part-time  in  any  program  at 
December  1st  of  the  same  year. 

# enrolled  full-time  December  1 ( Year  x)  - The  number  of  students  in  a program  who  are  enrolled  full- 

time in  any  credit  program  on  December  1 of  the  year  in  which  they  commenced  study  as  freshmen. 

# enrolled  full-time  or  part-time  December  1 (Year  x+1)  - The  number  of  students  enrolled  full-time  or 

part-time  in  any  credit  program  on  December  1 of  the  year  following  the  year  in  which  they 
commenced  study  as  freshmen. 

Retention  rate  - Year  to  Year  - The  number  of  students  enrolled  full-time  or  part-time  December  1 (Year 
x+1)  expressed  as  a percentage  of  the  number  enrolled  full-time  on  December  1 (Year  x). 

# of  full-time  freshman  students  as  of  December  1 (Year  x)  who  did  not  return  - The  number  of  full-time 

freshman  students  December  1 (Year  x)  minus  the  number  enrolled  December  1 (Year  x+1), 
categorized  as  follows: 

Required  to  Withdraw  - Not  permitted  to  continue  in  the  program  due  to  inadequate  academic 
performance.  (Number  and  Percentage  of  “Total  Not  Returning”). 

Transfers  to  AB  PSls  - Students  identified  through  the  ACAT  Duplicate  Application  Detection 
project  database  as  attending  another  Alberta  post-secondary  institution  in  the  Fall  of  Year  x+1. 
(Number  and  Percentage  of  ‘Total  Not  Returning”). 

Others  Not  Returning  - Students  not  returning,  not  identified  in  either  of  the  above  categories. 
(Number  and  Percentage  of  “Total  Not  Returning”). 
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Generating  Freshman  Persistence  Elements  from  CIS  Data  - The  following  steps  will  generate 

freshman  persistence  information  elements  from  CIS  data,  and  should  be  applicable  to  local  databases: 

1 . Identify  programs  for  which  freshman  persistence  rates  are  to  be  reported  and  classify  by  faculty. 

2.  For  each  program,  identify  the  full-time  freshman  students  on  September  30  of  the  base  year,  or  at  an 
earlier  date  at  which  the  number  of  full-time  freshmen  commencing  a program  can  be  reasonably 
determined.  Exclude  unclassified  students. 

3.  For  each  program,  check  whether  the  full-time  freshmen  students  as  of  September  30th  are  attending 
any  program  at  the  institution  as  of  December  1st.  Count  the  numbers  who  are  enrolled  and  active, 
full-time  or  part-time  at  the  institution  on  December  1 of  the  base  year. 

4.  For  each  program,  calculate  the  numbers  of  students  leaving  the  institution  between  September  30 
and  December  1. 

5.  For  each  program,  calculate  the  retention  rate  by  expressing  the  number  of  freshmen  students 
enrolled  full-time  or  part-time  at  December  1 as  a percentage  of  the  number  of  freshman  students 
enrolled  full-time  in  September. 

6.  For  each  program,  count  the  number  of  freshman  students  who  were  enrolled  full-time  on  December 
1 of  the  base  year  (Year  x)  and  who  are  enrolled  and  active,  full-time  or  part-time  in  any  credit 
program  on  December  1 of  the  subsequent  year  (Year  x+1). 

7.  For  each  program,  divide  the  number  enrolled  on  December  1 of  Year  x+1  by  the  number  enrolled  on 
December  1 of  the  base  year  (Year  x)  and  express  the  result  as  a percentage. 

8.  For  each  program,  count  the  number  of  freshman  students  who  were  enrolled  full-time  as  of 
December  1 of  Year  x who  did  not  return  for  the  following  Fall  session. 

9.  Identify  the  number  of  students  required  to  withdraw  and  express  this  number  as  a percentage  of  the 
total  not  returning  for  the  program. 

10.  Provide  a file  including  the  Duplicate  Application  Detection  data  elements  for  the  remaining  students 
to  the  Alberta  Council  on  Admissions  and  Transfer  office.  ACAT  will  return  the  file  showing  the 
institution  and  program  of  attendance  for  those  attending  an  Alberta  post-secondary  institution  in  the 
Fall  of  Year  x+1. 

11.  For  each  program,  count  the  number  of  students  identified  in  the  ACAT  data  as  attending  another 
Alberta  PSI  in  the  Fall  of  Year  x+1  and  express  this  number  as  a percentage  of  the  total  not  returning 
for  the  program. 

12.  Record  the  number  of  students  not  counted  in  Step  9 or  Step  1 1 as  “others  not  returning”  and  express 
this  number  as  a percentage  of  the  total  not  returning. 

Athabasca  University: 

This  indicator  is  not  being  reported  by  Athabasca  University.  AU  will  report  the  number  of  successful 

course  completions  for  all  students  (See  Athabasca  University  format  re:  Program  Completion  indicator  - 

Page  26). 
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UNIVERSITY  TRANSFER  PROGRAM  LEAVERS 


The  purpose  of  this  indicator  is  to  provide  information  with  respect  to  the  performance  of 
approved  University  Transfer  programs  at  the  seven  colleges  with  such  programs.  Two 
important  rates  traditionally  used  by  the  department  and  Alberta  Council  on  Admissions  and 
Transfer  (ACAT)  will  be  calculated  and  reported  so  as  to  reflect  the  various  possible  outcomes 
of  a University  Transfer  program  - the  percentage  of  the  total  number  of  full-time  students  in  a 
University  Transfer  program  that  transfer  in  a subsequent  year,  and  the  percentage  of  leavers 
that  transfer  after  leaving  the  program. 

Transfers  to  Alberta  universities  or  private  colleges  with  accredited  degree  programs  will  be 
included  in  the  calculation.  Supplementary  data  are  being  collected  and  separate  calculations 
are  done  for  transfers  to  degree-level  programs  and  to  other  programs  at  “Other  Alberta  Post- 
Secondary  Institutions”  (Colleges  and  Technical  Institutes). 

Because  Lakeland  College  is  funded  specifically  as  an  inter-provincial  college,  and  because 
auditable  data  is  available,  its  transfers  to  universities  in  Saskatchewan  will  be  included. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Transfer  rates  to  Alberta  universities  and 
private  colleges 

X 

Transfer  rates  to  other  Alberta  post-secondary 
institutions 

X 

Level  of  Reporting:  By  program  at  the  CIS  Standard  Name  level.  [See  Page  15] 

Scope:  The  nine  approved  University  Transfer  programs  at  the  seven  Public 

Colleges  which  offer  such  programs:  UT:  Bachelor  of  Arts,  UT: 
Bachelor  of  Business  Administration,  UT:  Bachelor  of  Education,  UT: 
Bachelor  of  Engineering,  UT:  Bachelor  of  Fine  Arts,  UT:  Bachelor  of 
Physical  Education,  UT:  Bachelor  of  Science,  UT:  Bachelor  of  Social 
Work,  UT:  General. 


KPI  Reporting  Manual 


Page  37 


December  1998 


Data  Elements  & Reporting  Systems: 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data  CIS 

“Cohort”  (Enrolment  in  Year  x)  CIS 

Status  at  college  - Fall  of  Year  x+1  - 
Same  UT  program  KPIRS 

Other  UT  program  KPIRS 

Other  degree  program  KPIRS 

Other  program  KPIRS 

Left  the  college  (“Leavers”)  KPIRS 

Attending  Alberta  university  or  private 
university  college- Year  x+1  (UN/PR)  KPIRS 

Attending  Alberta  university  or  private 
university  college- Year  x+2  (UN/PR)  KPIRS 

Attending  other  Alberta  post-secondary 
institution  - Year  x+1  - degree-level  (CTV)  KPIRS 

Attending  other  Alberta  post-secondary 
institution  - Year  x+2  - degree-level  (CTV)  KPIRS 

Attending  other  Alberta  post-secondary 
institution  - Year  x+1  - other  programs  KPIRS 

Attending  other  Alberta  post-secondary 
institution  - Year  x+2  - other  programs  KPIRS 


w.v.wwsw.v.y.y.; 


»>»»»»» 


Specifications  & Protocols: 

“Cohort”  ( Enrolment  in  Year  x)  - The  number  of  full-time  students  in  a University  Transfer  program  in 
a given  year  as  recorded  in  CIS.  Students  new  to  the  institution  later  than  the  Fall  session  are 
excluded  unless  in  a compressed  program  designed  for  transfer  in  the  following  Fall  (Year  x+1). 

Cohort  reference  year  - The  academic  year  of  attendance  of  the  cohort.  Usually  the  year  prior  to  the 
reporting  year. 

Status  at  college  - Fall  of  Year  (x+1)  - The  enrolment  status  of  students  in  the  cohort  at  the  college,  in 
the  Fall  of  Year  (x+1),  the  year  following  the  cohort  reference  year . Headcount  measures  of  the 
number  of  students  attending  the  following  types  of  programs: 

Same  UT  program  - Continuing  in  the  same  UT  program  as  in  Year  (x). 

Other  UT  program  - Enrolled  in  a different  UT  program. 

Other  degree  program  - Enrolled  in  a degree-level  program  (applied  degree  programs,  collaborative 
nursing,  and  certain  brokered  degree  programs)  at  the  college. 

Other  program  - Enrolled  in  a program  other  than  a UT  or  degree-level  program. 

Left  the  college  (“Leavers”)  - Not  enrolled  at  the  college  in  Year  (x+1). 

Attending  an  Alberta  university  or  private  college  with  accredited  degree  programs  - Year  (x+1),  Year 
(x+2)  - “Headcount”  measures  of  the  number  of  “leavers”  from  a university  transfer  program  in  one 
year  who  are  enrolled  in  a degree  program  at  an  Alberta  university  or  private  college  with  accredited 
degree  programs  in  each  of  the  next  two  years,  as  identified  in  the  AC  AT  Duplicate  Application 
Detection  database  for  the  Fall  session. 
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Attending  other  Alberta  post-secondary  institutions  - Year  (x+1),  Year  (x+2)  - “Headcount”  measures 
of  the  number  of  “leavers”  from  a program  in  one  year  who  are  enrolled  in  a program  at  an  Alberta 
institution  other  than  a university  or  a private  college  with  accredited  degree  programs,  in  each  of  the 
next  two  years,  as  identified  in  the  ACAT  Duplicate  Application  Detection  data  for  the  Fall  session. 
Data  will  be  segregated  for  degree-level  programs  (applied  degree  programs,  collaborative  nursing, 
certain  brokered  degree  programs  and  the  Fine  Arts  degree  offered  by  ACAD)  and  for  other 
programs. 

Transfer  rates  - Various  rates  of  transfer  and  continuation  will  be  calculated  to  show  the  flow  out  of  the 
UT  program  to  the  various  destinations,  the  primary  destination  being  transfer  to  university.  Two 
denominators  are  available  for  calculating  the  rates,  the  UT  cohort  itself,  and  the  portion  of  the  cohort 
that  did  not  return  to  the  institution  [Leavers].  Insofar  as  the  intent  is  to  track  the  entire  “cohort”  as 
defined  above,  the  “cohort”  will  be  the  primary  denominator.  Rates  calculated  for  the  number  of 
students  transferring  in  Year  (x+1)  can  be  updated  by  using  the  total  number  of  transfers  for  Year 
(x+1)  and  Year  (x+2)  when  the  latter  become  available. 


Generating  University  Transfer  Elements  from  DAD  Database  - CIS  will  be  used  to  identify  “cohorts” 
of  full-time  university  transfer  program  students  for  a given  year  for  each  institution.  Institutions  will  use 
this  data  to  prepare  a “leavers”  file,  including  an  identifier  which  will  enable  location  of  the  student  in 
the  Alberta  Council  of  Admissions  and  Transfer  (ACAT)  Duplicate  Application  Detection  (DAD) 
database,  if  attending  an  Alberta  university,  private  college  or  any  other  Alberta  post-secondary 
institution  in  either  of  two  subsequent  years. 

1 . CIS  will  be  used  to  provide  each  institution  with  University  Transfer  Programs  with  a list  of  those 
enrolled.  Students  who  entered  in  winter  or  spring  sessions  will  be  omitted,  since  they  are  not  likely 
to  have  earned  24  transfer  credits.  However,  students  entering  new  intensive  transfer  programs  -- 
beginning  in  Jan/Mar.  and  enabling  students  to  transfer  in  September  — will  be  added  to  the  cohort 
beginning  with  the  1995-96  cohort.  This  establishes  the  “cohort”  for  the  “cohort  reference  year” 
which  usually  will  be  the  year  prior  to  the  reporting  year. 

2.  Each  institution  will  use  this  list  to  prepare  a “leavers”  file  in  ACAT  Duplicate  Application 
Detection  format  with  the  following  elements: 

Cohort  reference  year  (7  character  field,  e.g.,  1995-96) 

Institution  code 
DAD  ID 

CIS  Standard  Name 
CIS  Student  ID 

Status  at  College  - “L”  = leaver 

“S”  = same  program 
“U”  = other  UT  program 
“D”  = other  degree-level  program 
“C”  = another  College  program 

and  forward  the  file  to  ACAT. 

3.  AECD  will  provide  ACAT  with  a current  list  of  degree-level  programs  at  colleges  and  technical 
institutes. 

4.  ACAT  will  run  “leavers”  files  for  current  and  prior  years  against  the  DAD  database  and  produce 
reports  showing  the  institution  and,  where  possible,  the  program  of  attendance  for  those  students 
attending  Alberta  institutions  and  will  report  this  information  back  to  the  “sending”  and  “receiving” 
institutions. 

5 . Institutions  will  prepare  KPI  indicator  data  for  AECD  and  enter  through  KPIRS. 
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Note  re:  Transfer  to  Institutions  Outside  Alberta  - There  are  no  system-level  sources  for  the 
information  regarding  student  transfer  to  institutions  outside  Alberta.  Graduate  and/or  leaver  follow-up 
studies  undertaken  by  each  institution  may  provide  data  to  support  a note,  commentary  and/or  estimates, 
particularly  where  there  are  established  relationships,  paths  or  patterns  of  transfer.  As  noted  above,  the 
official  transfer  rate  for  Lakeland  College  will  include  transfers  to  universities  in  Saskatchewan,  to  the 
extent  that  the  data  is  supported  by  auditable  records.  In  preparing  its  report,  Lakeland  College  should 
include  transfers  to  universities  in  Saskatchewan  and  maintain  auditable  records  of  the  source  data  and 
calculations. 
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TRANSFER  STUDENT  PERFORMANCE 


This  indicator  deals  with  the  question  of  how  students  who  first  attend  a university  transfer  program  at 
an  Alberta  public  college  subsequently  perform  at  university  by  measuring  the  number  who  are 
successful  in  their  first  year  following  transfer  to  a university  program. 


Indicators)  Apply  to: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

Percentage  of  transferees  successful  in  Year  1 - X X 


Level  of  Reporting:  By  sending  institution  at  the  CIS  Standard  Name  level.  [See  Page  15]. 

Scope:  Information  required  for  programs  to  which  students  are  admitted  on  the 

basis  of  academic  work  completed  in  a university  transfer  program  at 
one  of  the  seven  Alberta  public  colleges  with  approved  university 
transfer  programs. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Sending  institution 

_ 

KPIRS 

KPIRS 

Receiving  program  identification  data 

- 

KPIRS 

KPIRS 

Number  of  transferees 

- 

KPIRS 

KPIRS 

Number  successful  in  Year  1 

Number  successful  in  Year  1 / Number  of 

- 

KPIRS 

KPIRS 

transferees 

- 

KPIRS 

KPIRS 

Specifications  & Protocols: 

The  Alberta  Council  on  Admissions  and  Transfer  will  provide  each  university  with  a file  containing 
records  for  students  who  are  new  to  the  university  in  the  Fall  of  each  year  and  who  were  leavers  from  a 
University  Transfer  program  at  one  of  the  seven  public  colleges  offering  university  transfer  programs,  in 
one  of  the  two  prior  years.  Each  record  will  be  in  the  Duplicate  Application  Detection  project  format. 
These  students  will  constitute  the  Transfer  Cohort  in  each  reporting  year. 

The  Transfer  Cohort  will  be  tracked  to  account  for  the  number  of  students  who  have  not  withdrawn  and 
are  eligible  to  continue  (in  good  standing),  at  the  end  of  their  first  year  following  transfer. 


Sending  Institution  - One  or  more  of  the  following  public  colleges  which  offers  AECD  approved 

university  transfer  programs:  Grande  Prairie  Regional  College,  Grant  MacEwan  Community  College, 
Keyano  College,  Lakeland  College,  Medicine  Hat  College,  Mount  Royal  College,  Red  Deer  College. 
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Receiving  Program  - The  undergraduate  degree  program  to  which  a student  is  admitted  on  the  basis  of 
academic  work  completed  in  a university  transfer  program  at  a sending  institution. 

# of  Transferees  - The  number  of  full-time  students  who  left  a college  university  transfer  program  in 

one  of  the  two  previous  years  and  who  are  in  their  first  session  of  attendance  following  admission  to  a 
receiving  institution.  The  group  of  ‘"university  transfer  leavers”  is  defined  by  the  University  Transfer 
Program  Leavers  KPI.  The  group  of  “transferees”  will  be  identified  through  the  ACAT  Duplicate 
Application  Detection  Project  database  and  will  constitute  the  Transfer  Cohort  for  each  year  of 
reporting. 

# Successful  in  Year  1 - The  number  of  students  in  a transfer  cohort  who  have  not  withdrawn  and  are 

eligible  to  continue  with  undergraduate  study  at  the  end  of  their  first  year  after  transfer. 

# Successful  in  Year  1 /#  of  Transferees  - The  proportion,  expressed  as  a percentage,  of  the  transfer 

cohort  who  have  not  withdrawn  and  are  eligible  to  continue. 
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TRANSFERABILITY  of  COURSES 


The  purpose  of  this  indicator  is  to  provide  some  indication  of  the  transferability  of  courses 
among  Alberta  colleges  and  technical  institutes  and  Alberta  universities  and  private  university 
colleges.  Information  provided  through  the  Transfer  Guide  published  annually  by  the  Alberta 
Council  on  Admissions  and  Transfer  will  be  analyzed  to  provide  quantitative  indicators  of  the 
extent  of  transferability  of  courses  and  multi-course  transfer  agreements. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
: Institutes 

Universities 

Private  University 
Colleges 

Number  of  courses  accepted  by  1, 2,  3,  or 

more  Alberta  universities  or  private 

X 

- 

- 

colleges 

Number  of  transfer  agreements 

X 

- 

- 

W.V.V.V.V.V.V.V.V 


Level  of  Reporting:  By  institution  at  the  total  institution  level. 

Scope:  Transferability  indicator  information  will  be  generated  for  the  Colleges 

and  Technical  Institutes  included  as  “sending”  institutions  in  the  Alberta 
Council  on  Admissions  and  Transfer’s  Transfer  Guide  database. 


Data  Elements  & Reporting  Systems: 


Colleges  <&  Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Number  of  transfer  courses 
Number  accepted  by: 

Only  one  receiving  institution 
Only  two  receiving  institutions 
Only  three  receiving  institutions 
More  than  three  institutions 
Number  of  transfer  agreements 


ACAT/KPIRS 

ACAT  / KPIRS 
ACAT  / KPIRS 
ACAT  / KPIRS 
ACAT/KPIRS 
ACAT  / KPIRS 


Specifications  & Protocols: 

KPI  information  regarding  the  transferability  of  courses  from  Colleges  and  Technical  Institutes  to 
Alberta  universities  and  private  university  colleges  will  be  generated  from  an  analysis  of  the  current  and 
two  prior  years’  editions  of  the  Alberta  Council  on  Admissions  and  Transfer’s  Transfer  Guide  database, 
with  results  reported  for  each  “sending”  institution.  This  information  will  be  prepared  by  ACAT  using 
the  following  specifications: 

Sending  Institution  - An  Alberta  post-secondary  institution  from  which  students  are  transferring. 

Transfer  Course  - A course  or  cluster  of  courses  included  in  the  ACAT  Alberta  Transfer  Guide  database 
for  which  there  are  transfer  agreements  to  one  or  more  Alberta  universities  or  private  university 
colleges. 
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Number  of  Courses  Accepted  - Number  of  courses  accepted  for  transfer  credit  by  at  least  one  of  the  four 
Alberta  universities  or  a private  college  with  accredited  degree  programs. 

Receiving  Institution  - An  Alberta  university  or  private  college  with  accredited  degree  programs. 

Number  of  Transfer  Agreements  - The  total  number  of  transfer  agreements  (one  per  receiving  institution 
per  course)  between  a “sending  institution”  an  Alberta  university  or  private  college  with  accredited 
degree  programs,  as  recorded  in  the  ACAT  Alberta  Transfer  Guide  database.  One  transfer  course  may 
be  involved  in  up  to  eight  transfer  agreements. 

Generating  Transferability  Elements  - ACAT  maintains  a database  of  transfer  agreements  negotiated 
between  post-secondary  institutions  in  the  province.  From  this  source,  ACAT  produces  the  Alberta 
Transfer  Guide  which  contains  tables  for  each  Alberta  public  college  and  technical  institute.  For  each 
applicable  public  college  and  technical  institute  transfer  course,  the  Guide  shows  the  courses  and  their 
credit  weight  which  are  awarded  by  one  or  more  receiving  institutions  for  each  of  those  courses. 
Therefore,  for  each  college  and  technical  institute,  the  number  of  courses  that  are  transferable  to  one, 
two,  three  and  four  or  more  Alberta  university  or  private  university  colleges  can  be  counted. 

This  information  will  be  prepared  by  ACAT,  and  made  available  for  institutional  review  through  KPIRS. 
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GRADUATING  STUDENT  SATISFACTION 


Satisfaction  indicators  are  compiled  from  the  results  of  surveys  of  students  who  are  about  to 
graduate  from  each  Alberta  post-secondary  institution  to  determine  satisfaction  with,  and  self- 
reported  benefits  from,  the  education  received.  Results,  to  be  reported  by  program,  include  a 
number  of  indicators  common  to  all  AECD  sectors. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

% of  completers  satisfied  with  the  overall 
quality  of  their  educational  experience 

X 

X 

X 

% who  would  select  same  program 

X 

X 

X 

% who  would  select  same  institution 

X 

X 

X 

% of  completers  satisfied  with  the  quality  of 
teaching/instruction- 

X 

„ 

X 

• in  their  own  faculty 

- 

X 

- 

• in  other  faculties 

- 

X 

- 

% of  completers  reporting  benefits  - 
• for  continuing  education 

X 

X 

X 

• academic  benefit  / in-depth  knowledge 
in  a field 

X 

X 

X 

• skills  needed  for  employment 

X 

Y 

X 

Y 

X 

Y 

• improved  chances  of  good  income 

• opportunity  for  personal  development 
% of  completers  satisfied  with  overall 

program  relevancy 

A 

X 

X 

A 

X 

X 

A 

X 

X 

S5»SSIS!SS5Ss3c:S$SS3©5SSi:i«SSSSS«:»SS: 

Level  of  Reporting:  Graduating  student  satisfaction  information  is  required  by  program  for 

all  parchment  programs: 

Colleges  & Technical  Institutes  - at  CIS  ProgID. 

Vocational  Colleges  - at  CIS  Standard  Name  level. 

Universities  - at  CIS  Standard  Name  level. 

Private  University  Colleges  - at  CIS  Standard  Name  level. 

For  Preparatory  & Basic  Upgrading  (PBU)  program  areas  - data  is 
required  at  the  CIS  Standard  Name  level.  [See  Page  15] 


Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree,  Bachelor  Degree,  Masters  Degree  and  Ph.D.,  plus 
Preparatory  & Basic  Upgrading.  [See  Page  16] 
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Data  Elements  & Reporting  Systems: 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

CIS 

CIS 

# of  Completers  (Graduates) 

CIS 

CIS 

# of  Survey  Participants 

Would  select  same  program  {yes  / no  / no 

KPIRS 

KPIRS 

response} 

KPIRS 

KPIRS 

Would  select  same  institution  {yes  / no  / n r} 
Satisfaction  with  {fully  satisfied  / somewhat 
satisfied  / not  at  all  satisfied  / no  response} : 

KPIRS 

not 

KPIRS 

Relevancy  of  courses 

KPIRS 

reporting 

KPIRS 

Quality  of  teaching 

KPIRS 

KPIRS 

Overall  quality  of  experience 

Benefits  {a  great  deal  / somewhat  / not  at  all  / 
not  applicable} 

KPIRS 

in 

January 

KPIRS 

Improved  chances  of  getting  a job 

KPIRS 

- 

Skills  needed  for  particular  job 

KPIRS 

1999 

- 

In-depth  knowledge  of  field  of  study 

KPIRS 

KPIRS 

Opportunity  to  improve  generally 

KPIRS 

KPIRS 

Improved  chances  of  good  income 

KPIRS 

- 

Opportunity  to  continue  education 

KPIRS 

KPIRS 

Knowledge  to  prepare  for  job  [PBU] 

KPIRS 

- 

Improved  feelings  - self  & outlook  [PBU] 

KPIRS 

- 

Ability  to  study  & solve  problems  [PBU] 

KPIRS 

- 

Get  along  better  with  most  people  [PBU] 

KPIRS 

- 

Helped  achieve  goals  [PBU] 

KPIRS 

- 

Ability  to  communicate  in  English  [ESL] 

KPIRS 

- 

More  confident  using  English  [ESL] 

KPIRS 

- 

Help  learn  about  Canadian  culture  [ESL] 

KPIRS 

- 

Note:  The  KPIRS  software  calculates  and  captures  data  re:  number  of  responses  to  each  question. 


Specification  & Protocols: 

For  the  1998  round  of  data  collection,  colleges  & technical  institutes  will  report  results  from  their  exit 
surveys  of  1997-98  graduates.  Private  university  colleges  will  report  the  results  of  exit  surveys  (1997- 
98  graduates).  Universities  will  report  the  results  of  their  joint  1996  survey. 

(Prior  to  1996-97,  colleges  and  technical  institutes  were  reported  from  follow-up  surveys  conducted  by 
each  institution  six  to  nine  months  after  graduation.  For  1996-97,  colleges  & technical  institutes 
reported  results  from  both  the  follow-up  surveys  of  1995-96  graduates  and  the  exit  surveys  of  1996-97 
graduates.) 


NOTE  that  new,  system-wide  standards  have  been  developed  and  agreed  upon  for  1998-99  and  future 
years.  These  new  standards  have  already  been  provided  to  institutions.  They  are  reproduced  in 
Appendix  A to  provide  a ready  reference  to  procedures  for  collecting  and  reporting  data  in  the  fall  of 
1999. 

Institutions'  1997-98  data  will  have  been  collected  according  to  the  specifications  and  protocols  that 
appeared  in  the  November  1997  reporting  manual  and  these  standards  are  repeated  here  “for  the 
record ”. 
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Statistical  Adjustment 

Survey  results  are  adjusted,  using  standard  statistical  methods,  to  compensate  for  differences  in 
institutional  survey  populations  and  response  rates.  A description  of  the  methods  used  is  included  in  the 
Guidelines  for  Conducting  Employment  and  Satisfaction  Surveys  that  appear  in  Appendix  A. 

Survey  Methodology  & Common  Questions  - Colleges  & Technical  Institutes  - 

1 . Timing  - an  exit  survey  conducted  at  graduation.  This  may  be  done  in  class  in  the  last  days  of  the 
program  period,  or  as  a mail  or  telephone  survey  immediately  following  program  completion. 

2.  Reporting  - 1997-98  (exit)  Satisfaction  data  to  be  reported  in  January  1999. 

3.  Sampling  - all  students  who  indicate  at  the  end  of  the  program  period  that  they  expect  to  graduate 
(complete  the  program).  See  “Special  Note  #1  ” below. 

4.  Institutions  to  provide  AECD  a copy  of  survey  instrument  with  report. 

5 . Data  should  be  reported  in  “numbers”. 

6.  Administration  of  the  survey  instrument  by  telephone  is  acceptable,  but  may  require  some  adjustment 
to  the  wording  of  the  questions.  In  making  changes  to  improve  the  flow  of  the  instrument,  care 
should  be  taken  NOT  to  change  the  intent  or  meaning  of  questions. 

7.  If  any  adjustment  to  a common  question  is  necessary,  all  colleges  and  technical  institutes  and  AECD 
should  be  consulted  prior  to  implementation  of  the  change. 

Special  Note  1:  If  institutions  survey  students  during  the  last  couple  of  weeks  of  their  parchment 
program,  they  will  not  always  know  which  students  will  graduate.  However,  this  does  not  mean 
institutions  will  have  to  ask  students  to  include  their  names  on  the  survey  and  then  check  each 
individual  to  see  if  they  graduated.  The  set  of  people  surveyed  for  satisfaction  need  not  be  exactly 
the  same  as  the  set  of  people  surveyed  for  employment.  The  same  consideration  applies  to  the 
Preparatory  & Basic  Upgrading  programs. 

Special  Note  2:  Beginning  in  1997-98,  standards  for  reporting  completers  in  Preparatory  and  Basic 
Upgrading  programs  have  been  introduced  in  CIS.  The  new  standards  take  into  account  the 
Resulting  Qualification  code  associated  with  the  program.  Please  refer  to  Reporting  Completions  in 
Non-Parchment  Programs  (under  Student  Data  Element  #18  - Completion  Status)  in  the  CIS 
Reporting  Manual  (December  1988)  for  instructions  for  coding  completers  in  non-parchment 
programs.  Only  those  students  coded  as  completers  in  CIS  are  to  be  surveyed  for  KPI  purposes. 

Questions  Included  in  the  Survey 

Inclusion  of  the  following  questions  in  exit  surveys  conducted  by  individual  institutions  provides  the 
information  required  by  AECD  regarding  graduating  student  satisfaction.  Each  institution  is  to  use  the 
questions  as  worded,  but  may  order  the  questions  as  appropriate  in  relation  to  other  elements  of  a larger 
survey  instrument.  Particularly  with  respect  to  Preparatory  & Basic  Upgrading  programs,  where  the 
questionnaire  developed  by  an  institution  includes  many  questions  beyond  those  necessary  for  KPI 
purposes,  it  is  recommended  that  KPI  questions  be  placed  in  a cluster  of  related  questions  so  that 
respondents  will  answer  the  questions  within  a context  that  has  been  established  by  these  other  questions. 

1 . Do  you  believe  that  your  program  improves  your  chances  of  getting  a job? 

□ A great  deal  □ Somewhat  □ Not  at  all 

2.  After  attending  the  program: 

Would  you  choose  the  same  program  again?  □ Yes  □ No 

Would  you  go  to  (Name  of  Institution)  again?  □ Yes  □ No 
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3.  How  satisfied  were  you  with  your  program? 

ESL  and  ACADEMIC  UPGRADING  ONLY: 

Fully 

satisfied 

Somewhat 

satisfied 

Not  at  all 
satisfied 

The  program  taught  you  what  you  needed  to  learn 

□ 

□ 

□ 

Quality  of  teaching  was  good. 

□ 

□ 

□ 

The  program  helped  you  to  achieve  your  goals. 

□ 

□ 

□ 

Overall,  you  were  satisfied  with  the  school. 

□ 

□ 

□ 

“PARCHMENT”  PROGRAMS  ONLY: 

Fully 

satisfied 

Somewhat 

satisfied 

Not  at  all 
satisfied 

Relevancy  of  your  courses 

□ 

□ 

□ 

Quality  of  teaching 

□ 

□ 

□ 

Overall  quality  of  educational  experience 

□ 

□ 

□ 

4.  To  what  extent  did  the  program  provide  you  with  the  following  benefits? 

A Great 

ESL  STUDENTS  ONLY:  deal  Somewhat 

Not 

Not  at  all  applicable 

I am  satisfied  that  the  program  improved  my  ability  to 
communicate  in  English. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  helped  me  feel  more 
confident  in  using  English. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  helped  me  learn  about 
Canadian  customs  & culture. 

□ 

□ 

□ 

□ 

OTHER  PREPARATORY  & BASIC  UPGRADING: 

A Great 
deal 

Somewhat 

Not 

Not  at  all  applicable 

I am  satisfied  that  the  program  taught  me  knowledge  needed 
to  prepare  for  a job. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  prepared  me  to  go  on  to 
further  education  or  training. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  improved  my  ability  to  study 
and  solve  problems. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  improved  my  feelings  about 
myself  and  my  outlook  on  life. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  helped  me  get  along  better 
with  most  people. 

□ 

□ 

□ 

□ 

I am  satisfied  that  the  program  gave  me  skills  needed  to  find 
and  keep  a job. 

□ 

□ 

□ 

□ 

“PARCHMENT”  STUDENTS  ONLY: 

A Great 
deal 

Somewhat 

Not 

Not  at  all  applicable 

Skills  needed  for  a particular  job 

□ 

□ 

□ 

□ 

In-depth  knowledge  of  a field  of  study 

□ 

□ 

□ 

□ 

An  opportunity  to  improve  yourself  generally 

□ 

□ 

□ 

□ 

Improved  your  chances  of  a good  income 

□ 

□ 

□ 

□ 

Allowed  you  to  continue  your  education 

□ 

□ 

□ 

□ 

These  questions  will  be  reviewed  annually  and  amended  or  updated  in  consultation  with  the  Senior 

Student  Services  Officers’  committee  of  the  Council  of  Presidents. 
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Survey  Methodology  & Common  Questions  - Universities 

1 . Timing  - a survey  administered  to  graduating  students  at  the  end  of  the  year  in  which  they  are 
completing  a program  and/or  requirements  for  graduation.  The  universities’  survey  is  not  conducted 
every  year.  It  was  last  conducted  in  the  Spring  of  1996.  The  results  of  this  survey  will  be  reported 
each  year  until  the  next  survey  is  conducted. 

2.  Reporting  schedule  - reports  to  be  submitted  in  alternate  years  for  survey  results  in  the  year  prior,  in 
above  formats. 

3.  Sampling  - stratified  random  sample  across  all  degree,  diploma,  and  certificate  programs.  The 
sample  should  be  of  sufficient  size  to  provide  results  for  each  university 

4.  A survey  is  being  undertaken  jointly  by  three  universities  (Alberta,  Calgary,  and  Lethbridge)  on  a 
biennial  basis.  Athabasca  University  is  undertaking  an  annual  survey  of  all  students. 

5.  The  joint  survey  instrument  used  in  the  spring  of  1996  will  vary  from  survey  to  survey,  since  it 
includes  questions  that  each  university  wants  to  have  answered  for  its  own  planning  purposes. 
However,  for  KPI  reporting  purposes,  the  universities  have  agreed  that  the  common  questions  needed 
to  produce  KPI  data  required  by  AECD  will  be  included  in  each  survey. 

6.  Results  should  be  reported  numerically  (i.e.,  the  number  of  responses  rather  than  the  percentage  of 
respondents). 

7.  For  data  elements  “Would  select  same  Program”  and  “Would  select  same  University”,  the  numbers 
of  “Yes”  and  “Maybe”  responses  should  be  combined  for  reporting. 

The  survey  instrument  last  used  (Spring  1996)  by  the  universities  is  attached  as  Appendix  B. 


Survey  Methodology  & Common  Questions  - Private  University  Colleges 

1 . Timing  - a survey  administered  to  graduating  students  at  the  end  of  the  year  in  which  they  are 
completing  a program  and/or  requirements  for  graduation.  Note  that  if  the  survey  is  not  conducted 
every  year,  the  results  of  the  most  recent  survey  will  be  reported  each  year  until  the  next  survey  is 
conducted. 

2.  Reporting  schedule  - reports  to  be  submitted  for  each  year  in  which  a survey  is  undertaken. 

3.  Sampling  - full  population  survey  across  all  degree,  diploma,  and  certificate  programs. 

4.  Survey  instruments  will  vary  from  survey  to  survey  and  from  year  to  year,  since  it  includes  questions 
that  each  institution  will  include  questions  for  its  own  planning  purposes.  However,  for  KPI 
reporting  purposes,  the  private  colleges  have  agreed  that  the  common  questions  needed  to  produce 
KPI  data  required  by  AECD  will  be  included  in  each  survey. 

5.  Results  should  be  reported  numerically  (i.e.,  the  number  of  responses  rather  than  the  percentage  of 
respondents). 

6.  For  data  elements  “Would  select  same  Program”  and  “Would  select  same  Institution”,  the  numbers 
of  “Strongly  Agree”  and  “Agree”  responses  should  be  combined  for  reporting. 

The  survey  instrument  used  by  the  private  colleges  is  attached  as  Appendix  C. 
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Re:  Entering  Data  in  KPIRS 

Different  scales  and  terms  for  responses  have  been  used  for  Colleges  and  Technical  Institutes, 
Universities,  and  Private  University  Colleges.  The  following  table  sets  out  the  “correspondence”  of  these 
scales  and  terms  for  KPIRS  data  entry:  


5 

4 

3 

2 

1 

0 

Colleges  & Technical  Institutes  - 

Satisfaction 

fully 

satisfied 

somewhat 

satisfied 

not  used 

not  used 

not  at  all 
satisfied 

no 

response 

Colleges  & Technical  Institutes  - 

Benefits 

a great 
deal 

somewhat 

not  used 

not  used 

not  at  all 

not 

applicable 

Universities  - Satisfaction 

very 

satisfied 

satisfied 

neither 
/ nor 

dissatisfied 

very 

dissatisfied 

no 

response 

Universities  - Benefits 

strongly 

agree 

agree 

neither 
/ nor 

disagree 

strongly 

disagree 

no 

response 

Private  University  Colleges  - 
Satisfaction 

very 

satisfied 

satisfied 

neither 
/ nor 

dissatisfied 

very 

dissatisfied 

no 

response 

Private  University  Colleges  - 
Benefits 

definitely 

provided 

provided 

uncertain 

did  not 
provide 

definitely  did 
not  provide 

no 

response 

Private  University  Colleges  - Rating 
Aspects 

excellent=5 

4 

3 

2 

poor=l 

no 

response 
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GRADUATE  EMPLOYMENT  and  ACADEMIC  OUTCOMES 


The  purpose  of  this  information  set  is  to  determine  the  extent  to  which  graduates  of  career, 
professional,  training  and  general  programs  find  employment  related  to  their  education  and 
training  within  a reasonable  period  of  time,  pursue  post-graduate  academic  objectives  or  have 
intentions  to  do  so.  Data  are  reported  from  the  results  of  follow-up  surveys  of  graduates,  six  to 
nine  months  after  graduation  in  from  College  & Technical  Institute  programs  and  two  years  after 
graduation  from  University  and  Private  College  programs. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

# of  labour  force  participants 

X 

X 

X 

Labour  force  participation  rate 

X 

X 

X 

# employed 

Full-time 

X 

X 

X 

Part-time 

X 

X 

X 

In  jobs  directly  related 

X 

X 

X 

In  jobs  somewhat  related 

X 

X 

X 

In  jobs  not  related 

X 

X 

X 

Employment  rate 

X 

X 

X 

# unemployed  and  looking  for  work 

X 

X 

X 

Average  salary  of  those  employed  full-time 

X 

X 

X 

# currently  enrolled  in  a post-secondary 

program  - full-time 

X 

X 

X 

- part-time 

X 

X 

X 

# not  currenUy  enrolled  but  will 

X 

X 

X 

Level  of  Reporting:  Graduate  employment  and  academic  outcomes  information  is  required 

by  program  for  all  parchment  programs: 

Colleges  & Technical  Institutes  - at  CIS  ProgID. 

Vocational  Colleges  - at  CIS  Standard  Name  level,  by  program 

length. 

Universities  - at  CIS  Standard  Name  level,  by  program  length. 
Private  University  Colleges  - at  CIS  Standard  Name  level,  by 
program  length. 

For  Preparatory  & Basic  Upgrading  (PBU)  program  areas  - data  is 
required  at  the  CIS  Standard  Name  level.  [See  Page  15] 

Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree,  Bachelor  Degree,  Masters  Degree  and  Ph.D.,  plus 
Preparatory  & Basic  Upgrading.  [See  Page  16] 

Institutions  are  required  to  report  Preparatory  & Basic  Upgrading 
information  beginning  with  the  1996-97  reporting  year. 
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Data  Elements  & Reporting  Systems: 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

# of  graduates  (completers) 

# of  responses 

# employed  full-time  (30+  hrs  per  week) 

# employed  part-time  (<30  hrs  per  week) 
Total  employed 

Employment  rate 

# unemployed  and  looking  for  work 
Total  in  labour  force 

Labour  force  participation  rate 

# not  in  labour  force 

# of  responses  re:  average  salary 
Average  salary  of  those  employed  full-time 

# employed  in  jobs  directly  related 

# employed  in  jobs  somewhat  related 

# employed  in  jobs  not  related 

# currently  enrolled  in  a post-secondary 
program  - full-time 

- part-time 

# not  currently  enrolled  but  will 

# with  no  immediate  plans 


CIS 

CIS 

CIS 

CIS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

not 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

reporting 

KPIRS 

KPIRS 

in 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

January 

KPIRS 

KPIRS 

KPIRS 

1999 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

KPIRS 

- 

KPIRS 

- 

Specifications  & Protocols: 

Follow-up  Survey  - a survey  conducted  six  to  nine  months  after  graduation  for  Colleges  and  Technical 
Institutes,  two  years  after  graduation  for  universities  and  private  university  colleges. 

Program  Completer  ( Graduate)  - any  student  who  has  been  determined  by  the  institution  to  have 
completed  all  program  requirements  and  to  whom  the  institution  would  therefore  confer  a parchment 
where  a parchment  is  offered. 

Labour  Force  - persons  who  are  employed,  or  unemployed  but  looking  for  work  at  the  time  of 
responding  to  a graduate  survey. 

Employed  - persons  who,  at  the  time  of  responding  to  a graduate  survey,  did  any  work,  whether  full- 
time or  part-time,  for  salary,  wages  or  self-employed,  permanent  or  temporary,  related  or  unrelated  to 
the  graduate's  program  of  study. 

Unemployed  - persons  who,  at  the  time  of  responding  to  a graduate  survey,  are  without  work  but  are 
actively  looking  for  work. 

Employment  Rate  - the  number  of  employed  persons  expressed  as  a percentage  of  the  labour  force. 

Average  Monthly  Salary  for  Those  Employed  Full-time  - the  arithmetic  average  of  the  monthly  salaries 
reported  by  respondents  to  the  employment  income  question,  who  indicate  employment  on  a full-time 
basis  (greater  than  30  hours  per  week). 

NOTE  that  new , system-wide  standards  have  been  developed  and  agreed  upon  for  1998-99  and  future 

years.  These  new  standards  have  already  been  provided  to  institutions.  They  are  reproduced  in 
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Appendix  A to  provide  a ready  reference  to  procedures  for  collecting  and  reporting  data  in  the  fall  of 
1999 . 

Institutions'  1997-98  data  will  have  been  collected  according  to  the  specifications  and  protocols  that 
appeared  in  the  November  1997  reporting  manual  and  these  standards  are  repeated  here  “for  the 
record 


Statistical  Adjustment 

Survey  results  are  adjusted,  using  standard  statistical  methods,  to  compensate  for  differences  in 

institutional  survey  populations  and  response  rates.  A description  of  the  methods  used  is  included  in  the 

Guidelines  for  Conducting  Employment  and  Satisfaction  Surveys  that  appear  in  Appendix  A. 

Survey  Methodology 

1 . Timing  - For  ‘parchment”  programs  and  Preparatory  & Basic  Upgrading  programming  at  Colleges  & 
Technical  Institutes,  a follow-up  survey  administered  annually,  six  to  nine  months  following  date  of 
completion  of  program  and/or  requirements  for  graduation.  For  ‘'parchment  programs”  at 
Universities  and  Private  University  Colleges,  a follow-up  survey  administered  biennially,  two  years 
following  the  date  of  graduation. 

2.  Reporting  - data  to  be  submitted  in  the  year  following  any  year  in  which  a survey  has  been 
undertaken.  For  Colleges  and  Technical  Institutes,  data  from  the  survey  of  1997-98  graduates  will  be 
reported  in  for  the  1998-99  reporting  year.  For  Universities  and  Private  University  Colleges,  the 
results  of  surveys  last  reported  will  be  carried  forward. 

3.  Sampling  - For  Colleges  & Technical  Institutes,  full  population  survey  (all  graduates  or  completers), 
to  provide  each  graduate  with  an  opportunity  to  respond.  For  Universities  and  Private  University 
Colleges,  stratified  random  sampling  across  all  degree,  diploma,  and  certificate  programs  is 
acceptable,  provided  that  samples  are  of  sufficient  size  to  provide  results  for  each  institution  by 
program. 

4.  Survey  instruments  may  vary  from  institution  to  institution,  to  the  extent  that  each  includes  questions 
relevant  for  internal  planning  and  other  purposes.  Surveys  may  be  conducted  by  third  parties  on 
behalf  of  individual  institutions  or  a number  of  institutions,  as  was  the  case  for  Universities  for  the 
last  reporting  year.  Institutions  are  to  provide  AECD  a copy  of  survey  instrument  used  for  any  cycle 
of  reporting. 

5.  Data  should  be  reported  in  “numbers”.  Labour  Force  Participation  and  Employment  Rates  are 
calculated  by  the  KPIRS  software. 

6.  Administration  of  the  survey  instrument  by  telephone  is  acceptable,  but  may  require  some  adjustment 
to  the  wording  of  the  questions.  In  making  changes  to  improve  the  flow  of  the  instrument,  care 
should  be  taken  NOT  to  change  the  intent  or  meaning  of  questions. 

7.  If  any  adjustment  to  a common  question  is  necessary,  all  institution  and  AECD  should  be  consulted 
prior  to  implementation  of  the  change. 

8.  To  maintain  adequate  confidentiality,  employment  and  salary  information  should  not  be  reported  for 
classifications  or  categories  in  which  either  the  total  number  of  graduates  or  the  number  of 
respondents  is  less  than  three. 

9.  Institutions  are  to  make  every  effort  to  obtain  information  first-hand,  directly  from  the  graduate.  If 
employment  information  is  obtained  from  a parent  or  roommate,  for  example,  then  institutions  need 
to  make  sure  that  these  sources  can  be  checked  and  verified. 
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Common  Employment  and  Academic  Outcomes  Questions  for  All  Sectors,  Institutions  and  Programs 
(“Parchment”  and  Preparatory  & Basic  Upgrading): 

1 . Are  you  currently  . . . 

□ Self  employed 

□ Employed 

□ Not  employed  but  looking  for  a job 

□ Not  employed,  not  looking  for  a job 

2.  If  you  are  employed,  to  what  extent  is  the  work  related  to  the  program  from  which  you  graduated 

□ Directly  related  □ Somewhat  related  □ Not  related 

3.  If  you  are  employed,  is  it  full-time  or  part-time? 

□ full-time  (30+  hours  per  week)D  part-time  (less  than  30  hours  per  week) 

Working  your  usual  hours  what  would  be  your  current  monthly  employment  income  before 
deductions?  (If  paid  by  the  hour,  provide  an  estimate  based  on  your  usual  hours  of  work) 

$ per  month 

4.  Are  you  a student  now  or  will  you  enroll  soon? 

□ Currently  enrolled  full-time 

□ Currently  enrolled  part-time 

□ Not  enrolled,  but  will  enroll  within  the  next  year 

□ No  immediate  plans  to  enroll 

Note:  For  purposes  other  than  KPI  reporting,  both  the  institutions  and  AECD  may  require  information  about  the 
jobs  that  graduates  hold  and/or  information  about  their  employers’  main  areas  of  business,  industry  or  service. 
Therefore,  it  is  recommended  that  surveys  include  a question  which  collects  job  title  and  nature  of  employer’s 
activity. 
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DEMAND  and  CAPACITY 


The  purpose  of  this  information  set  is  to  show  the  level  of  demand  for  credit  programs  and  the 
degree  to  which  demand  is  being  met  by  program  opportunities  (capacity).  These  and  various 
other  measures  may  be  used  to  indicate  whether  there  is  sufficient  level  of  demand  for  programs 
and  whether  appropriate  structures  (institutions,  faculties,  departments,  programs)  are  in  place  to 
meet  the  demand. 


Indicator(s)  Apply  to: 

CoUeges  &Jechmcai 
Institutes 

Universities 

Private  University 
Colleges 

Qualified  applications  as  % of  entry  places 
available 

X 

Number  of  applications  and  applicants  to  this 
institution  only,  to  this  and  other 
institutions  - to  this  program  only,  to  this 
and  other  programs 

X 

% of  qualified  applications  not 
accommodated 

PBU  only 

m 

% of  available  course  seats  filled 

PBU  only 

- 

- 

Level  of  Reporting:  By  program  for  all  program  types  except  Preparatory  & Basic  Upgrading 

and  General  Studies. 

Colleges  & Technical  Institutes  - at  CIS  ProgID  level. 

Vocational  Colleges  - at  CIS  Standard  Name  level. 

By  “program  area”  for  Preparatory  & Basic  Upgrading  - data  generated 
at  the  course  level  is  to  be  aggregated  to  Program  Area  (Standard  Name). 
(See  Special  Provisions  below.) 


Scope:  Information  required  for  all  program  types  except  General  Studies: 

Preparatory  & Basic  Upgrading,  Skill  Training,  Trade  Certificate, 
Certificate,  Diploma,  Other  Career  (Post-Certificate),  University 
Transfer,  Applied  Degree,  and  Bachelor  Degree.  [See  Page  16] 
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Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

CIS 

. 

- 

Application  cutoff  by  quantity  (quantity) 

CIS/KPIRS 

- 

- 

Application  cutoff  by  date  (date) 

KPIRS 

- 

- 

Qualified  applications 

CIS 

- 

- 

Program  capacity  (entrants) 

CIS 

- 

- 

Qualified  applications  as  % of  capacity 

KPIRS 

- 

- 

# of  applicants  this  institution  only  this 

program  only 

DAD  / KPIRS 

- 

- 

of  applications  this  institution  only  this 

program  only 

DAD  / KPIRS 

- 

- 

4 

of  applicants  this  institution  only  this  and 

other  programs 

DAD  / KPIRS 

- 

- 

£ 

t of  applications  this  institution  only  this  and 

other  programs 

DAD  / KPIRS 

- 

- 

t of  applicants  this  and  other  institutions 

DAD  / KPIRS 

- 

- 

t 

t of  applications  this  and  other  institutions 

DAD  / KPIRS 

- 

- 

For  PBU  programming 

Program  area  (Standard  Name) 

CIS 

- 

- 

Application  cutoff  by  quantity  (quantity) 

CIS/KPIRS 

- 

- 

Application  cutoff  by  date  (date) 

KPIRS 

- 

- 

Qualified  applications 

CIS/KPIRS 

Registered  in  program 

KPIRS 

- 

- 

# of  qualified  applicants  not  accommodated 

% of  qualified  applicants  not 

KPIRS 

- 

- 

accommodated 

# of  course  seats  available 

KPIRS 

- 

- 

# of  course  seats  filled 

KPIRS 

- 

- 

% of  available  seats  filled 

KPIRS 

- 

- 

KPIRS 

- 

- 

Specifications  and  Protocols: 

Data  on  applications  and  capacity  is  available  from  CIS.  The  department  will  extract  this  information 
and  transfer  it  to  KPIRS.  Where  the  institution  has  not  reported  this  data  properly  in  CIS,  the 
responsibility  will  fall  to  the  institution  to  ensure  the  data  is  entered  into  KPIRS.  CIS  does  not  include 
the  course  load  data  needed  to  provide  the  aggregations  required  for  most  of  the  PBU  data,  however,  the 
number  of  qualified  applicants  and  application  cutoff  data  are  transferred  from  CIS  to  KPIRS. 

Duplicate  application  data  is  derived  from  the  Alberta  Council  on  Admissions  and  Transfer  (ACAT) 
Duplicate  Application  Detection  project  (DAD)  data.  The  department  will  extract  this  information  from 
the  DAD  database  and  transfer  it  to  KPIRS.  Institutions  will  be  able  to  view  the  data  in  KPIRS. 

All  Programs  except  Preparatory  & Basic  Upgrading  and  General  Studies: 

Qualified  applicant  / application  - An  application  by  a person  who  is  formally  seeking  admission  to  a 
program  at  an  institution  and  who  has  completed  and  submitted  the  required  application  form(s),  has 
paid  the  appropriate  application  fee  where  such  a fee  is  levied,  and  has  not  been  advised  by  the 
institution  that  he/she  is  not  qualified  for  the  program.  In  some  programs  there  are  no  standards  other 
than  completing  the  application  process.  A fee  is  relevant  where  an  institution  requires  a fee  payment 
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from  an  applicant  to  formally  complete  the  application  process  and  be  considered  for  a place  in  the 
program.  Refer  to  the  Program  Data  System,  in  the  CIS  Reporting  Manual  for  a description  of 
application  data  in  CIS. 

There  is  no  fixed  date  for  the  determination  of  numbers  of  qualified  applications.  All  qualified 
applications  to  a program  are  to  be  reported  for  the  “major”  intake  to  the  program.  For  the  system,  in 
most  cases  this  is  the  Fall  session.  Where  multiple  intakes  or  year  round  continuous  intake  is  the 
norm,  institutions  are  to  report  for  the  full  academic  year. 

Although  students  may  have  to  apply  for  admission  to  a specific  major  as  they  enter  second  year  of  a 
diploma  program,  institutions  should  count  only  those  applying  to  enter  the  program,  not  those 
continuing  in  the  program  after  completing  the  first  year. 

Where  institutions  do  not  complete  a full  evaluation  for  every  application,  the  number  of  “qualified” 
applications  will  be  determined  by  applying  a ratio  determined  from  the  portion  of  the  total 
application  pool  for  which  sufficient  review  was  performed  to  determine  those  qualified. 

Program  Capacity  - The  number  of  entry  places  available  in  a program  to  qualified  applicants  to  that 
program.  This  information  element  is  to  be  institutionally  determined  and  reported  through  CIS  after 
the  admission  process  is  completed.  Where  the  number  of  students  taken  into  the  program  is  less  than 
the  available  capacity,  the  latter  should  be  reported  to  reflect  fairly  the  number  of  entrants  that  the 
institution  was  prepared  to  serve  with  resources  available  for  the  program. 

Likewise,  in  cases  where  the  available  places  in  a program  are  increased  at  the  time  of  admission  in 
order  to  accommodate  more  of  the  qualified  applicants,  report  the  number  of  places  filled.  In  other 
words,  once  the  dust  has  settled,  the  intake  capacity  to  be  reported  is  the  larger  of  the  planned  intake 
capacity  and  the  # of  places  actually  filled.  Refer  to  the  CIS  Program  Data  Manual,  November  1997 
Update,  for  more  on  program  capacity. 

A student  place  available  in  a program  represents  the  capacity  needed  for  a full-time  student  to  take 
the  normal  full  load.  In  the  case  of  part-time  students,  the  normal  load  of  a part-time  student  is  less 
than  a full  load.  Thus,  if  the  program  accepts  more  than  one  student  into  a normal  full-time  place,  an 
adjustment  has  to  be  made  in  the  way  capacity  for  the  program  is  expressed  when  reporting  it  in  CIS. 
One  hundred  places  for  full  load  students  might  translate  into  200  or  300  places  if  all  students  are 
part-time.  The  number  of  such  places  needs  to  be  expressed  in  a way  that  is  consistent  with  the 
number  of  qualified  applicants.  That  is,  if  part-time  places  are  made  available  to  handle300  applicants 
for  part-time  study,  the  capacity  of  the  programs  should  not  be  reported  as  100  full  load  places,  but 
converted  to  300  places  for  part-time  students. 

For  programs  with  continuous  intake,  as  noted  above,  the  application  count  covers  all  applications  to 
attend  in  the  academic  year.  The  capacity  is  the  total  intake  that  can  be  obtained  during  the  year. 

Since  the  applications  and  capacity  are  being  reported  to  the  department  after  the  year  is  over,  the 
capacity  need  not  be  determined  until  the  academic  year  is  over  and  all  new  registrations  can  be 
counted.  The  capacity  will  always  be  at  least  as  big  as  the  number  of  places  filled  during  the  year. 

Application  Cutoff  - The  method  used  to  “cut  off’  or  limit  the  number  of  applications  after  which  limit 
applications  are  returned  without  consideration.  May  be  a date,  a predetermined  quantity,  a multiple 
of  the  program  capacity,  etc. 

Data  on  Application  Cutoff  is  provided  by  institutions  and  transferred  to  KPIRS  where  it  may  be 
edited  if  not  appropriate.  This  may  require  explanation  through  a note  in  the  notes  section  of  the 
KPIRS  screen  for  this  indicator. 

Applications / Applicants  to  “ This  Institution  Only ” - “This  Program  Only”  and  “ This  and  Other 
Programs”  - The  AC  AT  Duplicate  Application  Detection  database  will  be  used  to  identify  for  each 
institution  and  program  those  applicants  who  have  applied  only  to  one  institution.  At  a “program” 
level  at  the  given  institution,  the  number  of  applications  will  be  equal  to  the  number  of  applicants. 
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But  when  ACAT  produces  an  aggregation  of  programs  at  that  institution,  the  number  of  applications  is 
likely  to  exceed  the  number  of  applicants.  The  program  level  data  in  KPIRS  cannot  itself  be  rolled  up. 
This  must  be  done  by  ACAT  and  included  in  the  data  transferred  into  KPIRS.  In  order  for  there  to  be 
adequate  data  for  “This  Institution  --This  and  Other  Programs”  from  DAD,  all  applications  should  be 
included  in  the  institutional  DAD  file. 

Applications  /Applicants  to  “This  and  Other  Institutions”  - At  a “program”  level  at  the  given  institution, 
the  number  of  applications  will  be  equal  to  the  number  of  applicants  but  in  an  aggregation  of 
programs  in  the  “other  institutions”  count,  the  number  of  applications  is  likely  to  exceed  the  number 
of  applicants. 

Preparatory  & Basic  Upgrading  Programs 

For  Preparatory  & Basic  Upgrading  programming,  some  of  the  data  pertains  to  the  program  while  some, 

such  as  the  number  of  course  seats  available,  are  to  be  generated  at  the  course  level  and  aggregated  to 

Program  Area  (Standard  Name)  for  entry  through  KPIRS.  The  following  specialization  of  definitions 

and/or  methods  apply  : 

Program  Area  - The  broad  program  grouping  at  which  course  registrations  are  to  be  summarized  and 
reported  for  PBU  programs.  The  program  area  will  correspond  to  the  CIS  Standard  Name,  such  as 
Adult  Literacy,  ABE,  ESL. 

Qualified  Applicant  / Applications  - An  application  by  a person  who  is  formally  seeking  admission  to  a 
program  at  an  institution  and  who  has  completed  and  submitted  the  required  application  form(s),  has 
paid  the  appropriate  application  fee  where  such  a fee  is  levied,  and  has  not  been  advised  by  the 
institution  that  he/she  is  not  qualified  for  the  program.  This  is  reported  through  CIS  at  the  ProgID 
level  and  aggregated  to  the  Standard  Name  level  for  this  indicator. 

Registered  in  Program  - The  number  of  qualified  applicants  who  have  registered  in  the  program  and 
remain  enrolled  past  the  deadline  for  withdrawal  without  penalty  or  effect.  (These  are  the  “active” 
registrations  reported  in  CIS.) 

# of  Qualified  Applicants  Not  Accommodated  - This  number  should  reflect  those  students  wait-listed  or 

not  accepted  by  the  institution  because  seats  were  not  available  for  them  in  the  program,  course,  or 
courses  for  which  they  applied.  This  would  not  include  “No  Shows”  or  early  withdrawals  up  to  the 
date  that  an  institution  allows  students  to  “drop”  all  courses  without  penalty  or  effect. 

# of  Course  Seats  Available  - This  number  should  be  the  sum  total  of  course  spaces  (or  seats)  available 

for  students  in  a program  area  (Standard  Name  level).  This  figure  needs  to  include  spaces  available, 
not  only  for  full  time  upgrading/ESL  students,  but  also  spaces  reserved  for  students  registered  in  and 
counted  as  students  in  post-secondary  programs  but  who  are  taking  upgrading/ESL  on  a part-time 
basis.  If  class  sizes  are  temporarily  increased  to  accommodate  more  students,  and  no  additional 
resources  are  required  by  the  institution,  these  increased  sizes  will  be  reflected  when  the  number  of 
seats  filled  is  greater  than  the  number  of  seats  available.  If  additional  resources  are  being  used  to 
expand  capacity,  this  should  be  indicated  by  increasing  the  number  of  course  seats  available. 

# of  Course  Seats  Filled  - The  sum  total  of  course  spaces  which  are  being  occupied  by  students 

considered  active  in  the  course,  aggregated  to  the  Standard  Name  level. 

Application  Cut-off  - Once  this  limit  has  been  reached,  applications  are  returned  without  consideration. 
This  limit  may  not  apply  at  institutions  where  students  are  referred  to  the  next  available  intake,  where 
they  are  wait-listed,  or  accommodated  through  acceptance  of  larger  class  sizes,  restructuring  the 
program  or  other  measures,  as  demand  dictates. 
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INSTRUCTIONAL  PROCESS  & FACULTY  LOAD  INDICATORS 


A number  of  indicators  provide  information  to  assess  the  instructional  context,  instructional 
loads  of  teaching  units  and  the  average  teaching  loads  of  faculty  members. 

Particularly  for  the  indicators  applying  to  Universities,  the  policy  issues  addressed  include  what 
university  faculty  members  do,  how  their  time  is  distributed  across  primary  university  functions, 
what  instructional  loads  and  student  volumes  are  involved  and  how  these  volumes  relate  to  the 
availability  of  instructional  staff,  particularly  the  availability  of  continuing  academic  staff.  The 
context  for  all  of  these  indicators  is  the  full  set  of  activities  undertaken  by  faculty  members 
within  the  primary  institutional  functions  of  instruction,  research,  community  service,  and  the 
administrative,  internal  service  and  other  supporting  functions  necessary  for  effective 
institutional  operations. 

Measures  of  headcount  enrolment  and  average  class  size  are  included  for  Private  University 
Colleges,  to  indicate  levels  of  service  and  general  accessibility  to  faculty  and  other  instructional 
resources. 


Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Student  contact  hours  per  FTE  faculty 

X 

. 

. 

Percentage  of  faculty  time  spent  on 
instruction,  research  and  community 

service 

- 

X 

- 

Total  undergraduate  enrolment  (headcount) 

- 

X 

X 

Total  graduate  enrolment  (headcount) 

- 

X 

- 

Total  course  section  registrations 

- 

X 

X 

Proportion  of  course  section  registrations 

taught  by  continuing  academic  staff 

- 

X 

X 

Section  registrations  per  FTE  teaching  staff 

- 

X 

X 

Average  section  size 

- 

- 

X 

Level  of  Reporting:  By  Faculty,  Program  Division  or  equivalent  administrative  unit  for 

Colleges  and  Technical  Institutes.  By  Faculty  for  Universities.  At  the 
institutional  level  for  Private  University  Colleges. 

It  is  recognized  that  no  two  institutions  have  identical  organizational 
structures  and,  therefore,  comparisons  on  these  indicators  should  be 
regarded  as  valid  only  at  the  institutional  level,  or  for  programs  that 
involve  little  “service”  teaching  (cross-program  teaching  and/or  resource 
sharing),  unless  adjustments  have  been  made. 

Scope:  Information  required  for  all  credit  program  teaching. 
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Data  Elements  & Reporting  Systems: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

Data  reported  through  (or  calculated  by) 

Admin  unit 

CIS 

. 

_ 

Student  contact  hours  (SCH) 

CIS/KPIRS 

- 

- 

FTE  instructional  faculty 

KPIRS 

- 

- 

Student  contact  hours  per  FTE  faculty 

KPIRS 

- 

- 

Total  undergraduate  enrolment  (headcount) 

- 

KPIRS* 

CIS 

Total  graduate  enrolment  (headcount) 

- 

KPIRS  * 

- 

Total  course  section  registrations 

- 

KPIRS 

KPIRS 

Continuing  academic  staff 

Proportion  (%)  of  total  course  section 

■ 

KPIRS 

KPIRS 

registrations  taught  by  continuing  academic 
staff 

KPIRS 

KPIRS 

FTE  teaching  staff 

Course  section  registrations  per  continuing 

- 

KPIRS 

KPIRS 

academic  staff 

Mean  percentage  of  faculty  time  spent  on  - 

■■ 

KPIRS 

KPIRS 

- instruction 

- 

KPIRS 

- 

- research 

- 

KPIRS 

- 

- community  service 
# of  course  registrations  in  - 

■ 

KPIRS 

KPIRS 

- junior  course  lecture  sections 

- 

- 

- junior  course  other  sections 

- 

- 

KPIRS 

- senior  course  lecture  sections 

- 

- 

KPIRS 

- senior  course  other  sections 
# of  course  sections  - 

■ 

' 

KPIRS 

- junior  courses  lecture 

■ 

“ 

KPIRS 

KPIRS 

- junior  courses  other 

- senior  courses  lecture 

- senior  courses  other 

- 

- 

KPIRS 

KPIRS 

Average  section  size  - 

KPIRS 

- junior  courses  lecture 

_ 

_ 

KPIRS 

- junior  courses  other 

_ 

_ 

KPIRS 

- senior  courses  lecture 

_ 

_ 

KPIRS 

* 


The  University  of  Lethbridge  data  for  these  elements  will  be  drawn  from  CIS. 


Specifications  & Protocols: 

Student  contact  hours  per  FTE  faculty  (Colleges  and  Technical  Institutes) 

Admin  Unit  [ Faculty , Division  or  Department]  - Faculty  workload  is  to  be  reported  at  the  first  level 
of  organizational  classification  below  the  “institutional”  level.  The  organizational  aggregation  that  is 
called  “division”  at  one  institution  may  be  called  “department”  or  “faculty”  at  another.  The  analogy  at 
a university  is  usually  the  “faculty  or  school”.  An  equivalent  organizational  aggregate  should  be 
reported  by  colleges  & technical  institutes. 

Student  Contact  Hours  ( Credit ) - An  aggregation  of  contact  hours  per  student  per  week  times  the 
number  of  weeks  in  each  session  for  all  students  enrolled  over  the  reporting  period.  For  this  indicator 
SCHs  are  to  be  aggregated  by  the  organizational  unit  (Admin  Unit)  of  the  faculty  members 
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responsible  for  teaching  so  as  to  reflect  the  instructional  and  teaching  loads  of  the  unit  and  its 
associated  faculty. 

The  Student  Contact  Hour  (SCH)  information  reported  for  the  Access  indicator  set  (Institution  Actual) 
will  be  available  in  KPIRS.  This  data  may  be  acceptable  for  programs  where  students  receive  all  of 
their  instruction  in  courses  offered  by  faculty  in  the  organizational  unit  responsible  for  the  program. 
Otherwise,  institutions  will  need  to  adjust  this  data  for  “service”  and/or  “cross-divisional”  teaching. 
The  institutional  total  SCH  for  all  Admin  Units  should  reconcile  with  the  total  institutional  SCH  in  the 
Access  indicator  information  set. 

Instructional  Faculty  - Designated  academic  staff  who  teach  credit  courses  and/or  provide  academic 
services  in  support  of  academic,  vocational,  and  technical  instruction  for  credit.  Faculty  service 
officers,  administrative  professional  officers,  professional  librarians,  professional  counselors, 
instructional  assistants,  graduate  assistants,  and  other  academic,  professional  and  administrative  staff 
are  included  to  the  extent  of  their  involvement  in  teaching  or  equivalent  instructional  roles,  for  that 
portion  of  their  duties. 

Full-time  Equivalent  Faculty  - A staff  member  carrying  a normal  full-time  load  for  the  full  term  of  a 
reporting  period  has  a foil-time  equivalence  of  1 .0.  Full-time  equivalence  for  staff  who  are  not  full- 
time and/or  are  not  engaged  for  the  full  term  of  a reporting  period  should  be  determined  as  the  product 
of  proportionate  work  load  and  the  proportion  of  the  reporting  period  worked.  For  example,  where  a 
part-time  staff  member  has  carried  a proportionate  workload  of  0.70  for  half  of  the  reporting  year,  the 
reported  full-time  equivalence  should  be  0.35. 

Re:  “partial  instructional  assignments”  - instructional  assignments  should  be  pro-rated  in  cases 
where  individuals  do  not  have  full-time  instructional  assignments. 

Re:  “non-traditional  modes  of  delivery”  - equivalency  estimates  should  be  made  for  involvement 
with  non-traditional  modes  of  delivery. 

Staffing  information  from  institutional  data  sources  should  be  consistent  with  the  information  reported 
to  AECD  through  FIRS  and  for  other  purposes. 

Mean  percentage  time  spent  on  Instruction , Research , and  Public  Service  ( Universities ): 

Alternative  sources  for  this  information  include  reports  currently  prepared  by  faculty  members  and 
submitted  to  department  chairs  or  deans  on  an  annual  basis,  or  an  annual  survey  designed  and 
administered  for  the  specific  purpose  of  generating  this  Information. 

The  proportion  of  time  spent  on  administration  and  institutional  service  is  not  to  be  separately 
reported.  Administration  and  institutional  service  includes  activities  that  support  the  University’s 
outputs  of  instruction,  research,  and  community  service.  Consequently,  the  time  a faculty  member 
spends  on  administration  and  institutional  service  is  to  be  allocated  across  each  of  these  outputs  by  the 
faculty  member  in  the  proportion  to  the  time  spent  on  each. 

The  time  spent  on  graduate  student  thesis  supervision  is  to  be  divided  between  instruction  and 
research.  Since  variation  among  faculties  is  expected,  the  division  of  this  time  will  need  to  be 
determined  on  a Faculty  by  Faculty  basis. 

Instruction  - All  activities  that  are  part  of  an  institution’s  instructional  programming  and  the 
delivery  of  all  courses  including: 

- teaching  classes;  leading  seminars;  supervising  laboratories,  studios,  rehearsals,  and 
performances;  supervising  work  experience  and  practical  off  campus  activities 

- supervising  independent  study 

- preparing  and  developing  teaching  materials  and  procedures 

- engaging  in  academic  and  professional  development  activities  that  support  or  enhance  teaching 
and  which  are  distinguished  from  supporting  the  production  of  some  specific  scholarly  output 

- preparing  and  grading  assignments  and  examinations 
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- meeting  with  students  during  office  hours  (to  discuss  class  material,  answer  questions,  review 
progress,  and  advise) 

- serving  as  course  coordinator  for  courses  with  more  than  one  section  or  as  coordinator  of 
laboratory  sections  and  tutorials  (Athabasca  University  only) 

Research  - All  activities  specifically  organized  to  produce  some  type  of  scholarly  outcome 
including: 

- developing  and  submitting  grant  proposals  or  applications  for  research  funding 

- creating  new  knowledge  using  research  methods  and  procedures  which  are  appropriate  to  and 
accepted  for  the  discipline 

- writing  articles,  books,  plays,  poems,  or  reviews 

- painting,  composing  music,  giving  a recital 

- engaging  in  academic  and  professional  development  activities  that  lead  to  or  support  the 
production  of  some  specific  scholarly  output,  including  reading  related  to  one’s  discipline; 
attending  professional  meetings;  taking  courses;  engaging  in  discussions  with  faculty  about 
disciplinary  issues;  and  preparing  and  delivering  papers  at  conferences 

- reviewing  proposals  submitted  to  granting  councils  and  foundations,  and  articles  and  other  forms 
of  scholarly  outputs  submitted  for  publication  and  dissemination. 

These  activities  may  be  either  unfunded  or  be  sponsored  through  a grant  or  contract  which  is 
administered  and  managed  within  the  University. 

Supervision  of  Graduate  Students  - Activities  related  to  the  supervision  of  graduate  students: 

- advising  graduate  students  about  academic  and  personal  matters 

- supervising  work  of  graduate  students  related  to  theses  and  research  projects. 

Community  Service  - Professional  activities  that  occur  outside  of  the  University.  May  involve: 

- liaison  with  public  and  private  secondary  schools,  provincial  colleges  and  institutes,  national  and 
international  universities,  colleges  and  institutes 

- providing  service  to  a discipline,  holding  office  in  a professional  organization,  editing  a journal 

- presenting  an  invited  address  or  paper 

- providing  service  to  a university  Senate 

Community  service  also  includes  service  to  the  external  community  related  to  the  exercise  of  one’s 
academic  and  professional  expertise.  These  activities  may  involve  consulting;  adjudications, 
arbitrations,  and  commissions;  giving  lectures  or  speeches;  holding  office  in  a public  organization. 

Administration  and  Institutional  Service  - Refers  to  a broad  category  of  activities  that  support  the 
University’s  primary  outputs  of  instruction,  research,  and  community  service.  These  activities 
include: 

- serving  on  university.  Faculty  and  departmental  councils  and  committees 

- performing  administrative  duties  which  are  part  of  the  assigned  workload 

- performing  administrative  duties  associated  with  a formal  administrative  appointment 
(President,  Vice-President,  Associate  Vice-President,  Dean,  Director,  Department  Chair, 
Associate  Department  Chair,  program  coordinator,  course  coordinator). 

Undergraduate  & Graduate  Enrolment  (Unduplicated  Headcount): 

These  are  the  same  data  as  reported  for  the  Access  indicator,  reported  at  the  Faculty  level  for 
universities  and  at  the  institutional  level  for  private  colleges.  Over  the  course  of  a reporting  year,  a 
number  of  students  may  enroll  in  more  than  one  program.  Accordingly,  institutional  totals  arrived  at 
by  the  simple  addition  of  program  totals  will  not  agree  with  unduplicated  headcounts  produced  at 
these  higher  levels  of  aggregation.  Where  the  data  is  available,  CIS  will  be  used  to  produce 
unduplicated  total  headcounts  at  the  institutional  level  and  these  will  be  used  in  place  of  totals 
produced  by  simply  summing  the  program  headcounts. 
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Proportion  of  Course  Sections  Taught  by  Continuing  Academic  Staff  & Section  Registrations  per 
FTE  Academic  Staff  (Universities  and  Private  University  Colleges ): 

The  total  number  of  course  section  registrations  taught  by  continuing  academic  staff  members  divided 
by  the  total  course  section  registrations  for  each  Faculty  (or  the  institution,  if  a private  college)  will  be 
used  to  obtain  the  proportion  taught  by  continuing  academic  staff:  The  total  course  section 
registrations  for  each  Faculty  (or  the  institution,  if  a private  college)  divided  by  the  number  of 
available  teaching  staff  (full-time  equivalents)  in  that  year  will  be  used  to  obtain  the  average  number 
of  course  registrations  per  full-time  equivalent  teaching  staff  member.  Each  institution  will  disclose 
the  details  of  methods  used  for  calculating  full-time  equivalents  for  part-time  and/or  short-term  staff 
members. 

Course  - Organized  subject  matter  in  which  instruction  is  offered  within  a given  period  of  time  and 
for  which  credit  towards  graduation  or  certification  is  given. 

Course  section  - A group  of  students  which  meets  together  for  instruction  or  for  which  the  elements 
and  resources  of  instruction  are  organized  and  administered.  Courses  with  a large  number  of 
students  are  generally  divided  into  two  or  more  sections  which  meet  at  different  times  and/or 
different  places.  A course  may  have  sections  of  different  types  including  lecture,  seminar, 
laboratory,  studio,  independent  study,  clinical  experience,  practicum,  internship,  field  placement, 
work  experience,  research,  developmental  and/or  design  project. 

Course  section  types  are  organized  into  three  categories:  lectures,  seminars  (instructional  activity 
distinguished  by  relatively  small  registration  and  considerable  group  discussion),  and  laboratories 
(the  remaining  section  types;  instructional  activity  which  requires  special  purpose  equipment 
and/or  involves  independent  student  study  and  observation  of  students  in  a studio,  clinical  or  field 
setting). 

Course  section  registration  - One  student  registered  in  a section  of  a course.  A student  registered  in  a 
term  or  half-course  is  counted  as  one  registration;  a student  registered  in  a full-course  is  counted  as 
two  registrations,  one  for  each  term.  A student  enrolled  in  a course  with  different  types  of  sections 
is  counted  for  each  of  these  sections  (for  example,  a student  registered  a half-course  consisting  of  a 
lecture  and  a laboratory  is  counted  as  two  registrations,  one  for  the  lecture  and  one  for  the 
laboratory).  The  total  number  of  course  section  registrations  for  a course  is  the  total  of  the  section 
registrations  for  each  section  across  all  section  types. 

Continuing  Academic  Staff  - Regular  faculty  members  who  have  tenure  or  probationary  appointments 
which  can  lead  to  tenure  and  who  may  be  employed  full-time  or  part-time,  including  professors, 
associate  professors,  assistant  professors,  and  lecturers.  This  classification  includes  academic 
assistants  with  continuing  appointments  (at  the  University  of  Lethbridge)  but  does  not  include 
limited  term,  sessional,  or  tutorial  instructors  who  have  appointments  with  definite  terms,  or 
graduate  teaching  assistants. 

Teaching  Staff  - A measure  of  the  total  staff  available  for  teaching  in  full-time  equivalents,  less  the 
full-time  equivalents  of  staff  members  on  sabbatical  and  those  with  appointments  to  administrative 
positions.  Teaching  staff  includes  professors,  associate  professors,  assistant  professors,  and 
lecturers;  limited  term,  sessional,  and  tutorial  instructors  and  graduate  teaching  assistants  (in 
universities). 


Average  course  section  size  ( Private  University  Colleges ): 

Reported  at  the  institutional  level  by  the  private  colleges,  average  section  size  is  calculated  for  lecture 
sections  and  other  (seminar  and  laboratory)  sections  for  junior  (the  level  of  course  usually  associated 
with  first  year  instruction)  courses  and  senior  (all  other)  courses.  The  average  section  size  is 
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determined  by  dividing  the  total  number  of  section  registrations  by  the  total  number  of  sections  for 
each  combination  of  course  level  (junior,  senior)  and  section  type  (lecture,  other).  Lecture  sections 
carrying  less  than  2 credits  in  value  are  omitted  as  are  all  private  study  sections,  including 
independent  study  and  private  music  instruction  courses.  All  labs  and  seminars  are  included  in 
'Other'. 
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PROGRAM  COSTS 


Measures  of  the  unit  costs  of  programming  to  indicate  that  resources  are  used  efficiently  over 
time  and  that  costs  of  programs  are  comparable  to  those  of  similar  programs  at  other  institutions 
of  comparable  size,  location  and  function.  The  indicators  deal  with  financial  resource  utilization 
by  measuring  the  average  costs  of  providing  instruction  in  various  programs. 


indicators)  Apply  to: 

Average  cost  per  FLE  enrolment 
Average  cost  per  student  contact  hour 


Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

X 

X 

X 

X 

- 

Level  of  Reporting:  By  program. 

Colleges  & Technical  Institutes  - at  CIS  ProgID  level. 

Vocational  Colleges  - at  CIS  Standard  Name  level. 

Universities  - at  CIS  Standard  Name  level,  by  program  length. 

Private  University  Colleges  - at  CIS  Standard  Name  level,  by  program 
length. 


Scope:  Information  required  for  all  credit  program  types:  Preparatory  & Basic 

Upgrading,  Skill  Training,  Trade  Certificate,  Apprenticeship,  Certificate, 
Diploma,  Other  Career  (Post-Certificate),  University  Transfer,  Applied 
Degree,  Bachelor  Degree,  Masters  Degree,  Ph.D.  and  General  Studies, 
[see  Page  16] 

For  Colleges  and  Technical  Institutes,  and  for  Universities,  data  is  to  be 
generated  and  entered  for  each  program  for  which  FLE  enrolment  is 
reported  for  the  Access  indicators.  Private  University  Colleges  and 
Alberta  Vocational  Colleges,  which  report  Access  indicator  data  at  the 
CIS  ProgID  level,  are  to  report  at  the  Standard  Name  level  for  this 
indicator. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 

Institutes 

• Universities " 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

CIS 

KPIRS  * 

CIS 

Instructional  costs 

KPIRS 

KPIRS 

KPIRS 

Service  & support  costs  & overheads 

KPIRS 

KPIRS 

KPIRS 

Total  program  costs 

KPIRS 

KPIRS 

KPIRS 

Research  costs 

- 

KPIRS 

- 

Full-load  equivalent  enrolment 

CIS 

KPIRS  * 

CIS 

Cost  per  FLE  enrolment 

KPIRS 

KPIRS 

KPIRS 

Student  contact  hours  (credit) 

KPIRS 

- 

- 

Cost  per  student  contact  hour 

KPIRS 

- 

- 

38SS8883S3B3838888S8 


The  University  of  Lethbridge  data  for  these  elements  will  be  drawn  from  CIS. 
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Specifications  & Protocols  - Colleges  & Technical  Institutes: 

Program,  Full-load  Equivalent  Enrolment  and  Student  Contact  Hours  (Credit)  data  will  be  drawn  from 
the  Access  indicator  data.  Instructional  Costs  and  Service  & Support  Costs  & Overheads  are  to  be 
determined  in  accordance  with  the  costing  procedures  set  out  in  the  following  and  entered  through 
KPIRS. 

Costing  procedures  for  Colleges  & Technical  Institutes: 

The  following  procedures  and  protocols  have  been  agreed  upon  by  a special  working  group  established 
by  the  Colleges  and  Technical  Institutes  Senior  Business  Officers'  Committee  and  representatives  of 
AECD.  They  provide  a general  framework  for  cost  accounting  and  cost  allocation  that  can  be  applied 
across  a relatively  diverse  set  of  institutions  to  produce  program  costs  that  are  sufficiently  comparable 
for  the  purposes  of  KP I reporting . 

The  framework  and  general  methods  proposed  are  “full  cost”  or  “full  absorption  cost”  methods.  They 
are  “activity  based”  to  the  extent  that  allocations  are  based,  insofar  as  practical  given  the  purposes,  on 
activity  information.  It  is  staged  so  as  to  provide  direct  costs  of  instruction  on  a student  program  basis, 
prior  to  any  indirect  or  overhead  allocations,  and  then  to  provide  “full”  cost  information.  This  enables 
use  of  information  regarding  direct  cost  differentials  before  it  is  masked  by  indirect  cost  allocations, 
especially  in  situations  where  a low  direct  cost  activity  makes  extensive  use  of  one  or  more  indirect  cost 
resources. 

The  method  facilitates  reconciliation  to  general  ledger  and/or  financial  statement  totals,  provided  that  the 
common  classification  structure  is  being  followed  and/or  that  departures  from  the  common  classification 
are  recorded  and  disclosed.  This  reconciliation  is  important  and  should  be  performed  at  each  stage  of  the 
process  particularly  where  the  costing  is  not  being  undertaken  with  the  same  level  of  detail  for  all 
functions  and/or  programs. 

In  a context  where  there  are  significant  differences  in  institutions,  their  program  mandates,  organizational 
structures,  accounting  methods,  financial  systems  and  a variety  of  other  factors,  a common  approach  to 
cost  allocation  methods  and  procedures  is  essential.  Key  elements  include  classification  structures, 
definitions,  allocation  procedures  and  the  ordering  of  key  stages  and  steps  of  the  methodology. 

Adherence  to  the  approach  set  out  in  the  following  steps  should  keep  “methodological  variance”  (i.e., 
differences  in  costs  which  might  be  attributed  solely  to  differences  in  methodology)  within  reasonable 
and  practicable  limits. 

The  proposed  general  method  has  the  following  steps: 

1 . Identify  the  departments,  activity  and  or  cost  centres  (hereinafter  referred  to  as  “cost  centres”)  and 
the  student  programs  and  other  cost  objectives  for  which  final  costs  are  to  be  determined.  These 
should  be  in  accordance  with  the  functional  classification  structure  and  definitions  used  for  FIRS 
reporting.  Note  that  program  costs  should  be  determined  for  each  “ProgID”  and  or  any  other  level  of 
aggregation  for  which  enrolment  and  instructional  load  information  is  being  generated  for  the  Access 
indicators. 

2.  Classify  (“crossover”  and/or  reclassify)  direct  expenditures  from  institutional  accounts  to  the 
common  classification  structure  (if  not  already  so  classified).  This  step  should  include  adjusting, 
prorating  or  “splitting”  pooled  or  shared  expense  items,  including  faculty  and  staff  who  hold  “joint” 
appointments  and  teach  in  more  than  one  program  area,  and  those  academic  support  costs  (e.g., 
deans,  directors,  program  heads  or  chairs,  and  associated  costs)  and  any  other  costs  (e.g.,  major 
facilities  or  other  supporting  operations)  that  can  be  attributed  directly  to  a program  division  or  group 
of  programs.  Adjustments  may  also  include  the  identification  and  distribution  of  costs  bom  by 
academic  units  for  primary  functions  other  than  instruction  (including  the  distribution  of  faculty 
compensation  and  other  expenses  based  either  on  the  results  of  faculty  activity  analysis  or 
assignment  data  if  available);  and  adjustments  for  charge  backs,  cost  recoveries,  etc.  Prorations 
and/or  splits  should  be  made  on  some  activity-based  method. 
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3.  Develop  an  “instructional  workload  matrix”.  This  step  may  not  be  required  for  all  institutions.  In 
some  institutions,  a substantial  volume  of  instruction  is  delivered  from  a number  of  instructional 
programs,  departments  or  cost  centres,  to  students  in  programs  which  are  not  otherwise  directly 
associated  with  those  centres.  The  technique  represented  by  the  instructional  workload  matrix  is  a 
relatively  efficient  way  to  transfer  the  associated  costs  from  the  delivery  units  to  the  recipient 
programs.  Institutions  which  have  relatively  self  contained  programs  (i.e.,  where  nearly  all  students 
take  nearly  all  of  their  instruction  in  courses  offered  by  the  same  cost  centre),  may  find  it  more 
efficient  to  make  “activity-based”  adjustments,  allocations  and/or  prorations  of  cost  for  the  services 
provided  from  one  program  to  students  in  other  programs,  where  necessary. 

4.  Calculate  direct  unit  costs  for  instruction  from  each  cost  centre  identified  in  the  “instructional 
workload  matrix”  if  a matrix  has  been  used.  These  are  used  to  transfer  costs  from  cost  centres 
offering  the  instruction  to  student  programs  on  the  basis  of  the  distributions  of  “units”  in  the  matrix, 
resulting  in  accumulations  of  instructional  costs  for  each  student  program  (and  for  each  year  and/or 
level  of  program  as  required). 

5.  Cross- allocate  indirect  services,  support,  and/or  overhead  costs  to  remaining  functions  and  to 
programs  and  other  final  cost  objectives  on  the  following  bases: 

5.1  Institutional  Support  Allocation  on  the  basis  of  direct  expenditures  after 

transfers  and/or  adjustments  in  Steps  2,  3 and  4. 

5.2  Academic  Support  Allocate  to  program  based  on  FLE  enrolment,  after 

allocation  of  costs  specifically  attributable  to 
Continuing  Education  (Non-Credit)  based  on 
unduplicated  headcount;  and  after  adjustments, 
prorations  and/or  “splits”  for  Academic  Administration 
costs  in  Step  2. 

(Details  of  specific  allocations  to  be  disclosed.) 

5.3  Student  Services  Allocate  to  program  based  on  FLE  enrolment,  after 

allocation  of  costs  specifically  attributable  to 
Continuing  Education  (Non-Credit)  based  on 
unduplicated  headcount. 

(Details  of  specific  allocations  to  be  disclosed.) 

5.4  Facilities  Management,  Allocate  to  program  based  on  FLE  enrolment,  after 

Operations  and  Maintenance  allocation  of  costs  attributable  to  specific  programs  or 

program  areas. 

(Details  of  specific  allocations  to  be  disclosed.) 

5.5  Amortization  Allocate  using  same  method  as  Facilities  Management, 

Operations  and  Maintenance,  unless  institution  has  a 
more  specific  method,  in  which  case  the  details  of  the 
method  should  be  disclosed. 

Some  institutions  use  more  specific  and  accurate  activity-based  cost  allocation  procedures  than  the 
general  methods  called  for  in  the  foregoing.  The  use  of  these  more  specific  procedures  in  program 
costing  is  encouraged,  with  disclosure  in  a brief  note  describing  the  method. 

6.  KPI  Reporting  does  not  call  for  the  inclusion  of  revenues  in  costing  reports  at  a program  level. 
However,  where  revenues  are  generated  from  the  sale  of  ‘"byproducts”  of  instruction  (e.g.,  the  sale  of 
meat  in  a meat-cutting  program,  products  of  construction  in  a house  building  program,  etc.),  an 
amount  not  greater  than  the  lesser  of  the  total  revenue,  or  the  cost  of  materials  consumed  in  creating 
the  goods  or  services  sold,  may  be  deducted  from  costs.  A reconciliation  of  aggregate  total  program 
costs  with  total  institutional  expenditures  is  required  as  part  of  the  costing  procedure  and  will  need  to 
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include  disclosure  of  the  specific  costs  recovered,  overheads  allocated,  and  the  total  amounts  of 
revenue  involved. 

7.  Ancillary  Enteiprise  expenditures  should  be  excluded.  AECD’s  policy  is  that  ancillary  services  should 
operate  on  a full  cost  recovery  basis.  On  the  assumption  that  this  policy  is  being  followed  and  that  fair  and 
reasonable  allocations  of  support  costs  and  overheads,  and  capital  amortization  are  being  made,  ancillary 
services  can  be  excluded  from  the  costing  model.  Amounts  excluded  and  corresponding  revenues  will 
need  to  be  disclosed  in  the  reconciliation  of  aggregate  total  program  costs  with  total  institutional 
expenditures. 

8.  Costs  for  programming  that  does  not  generate  “official”  FLE  for  CIS  reporting  should  be  identified 
on  a program  by  program  basis,  excluded  and  entered  in  the  reconciliation.  [See  “Reconciliation 
with  Total  Operations  Expenditures”  below.] 

The  Instructional  Costs  and  Service,  Support,  Overhead  Allocations  for  each  program  are  to  be  entered 
through  KPIRS.  The  KPIRS  application  will  already  include  Program,  FLE  Enrolment  and  Student 
Contact  Hours  data  for  each  “ProgID”  or  any  other  level  of  aggregation  for  which  Access  data  is  being 
generated,  and  will  calculate  Total  Program  Cost,  Cost  per  FLE  and  Cost  per  SCH  for  each.  For  this 
application  of  KPIRS  to  work  effectively,  it  is  necessary  that  the  Instructional  Cost  and  Service,  Support 
& Overhead  Allocations  correspond  with  “programs”  for  which  Access  data  is  reported  on  a one-to-one 
basis. 


Specifications  & Protocols  - Universities: 

Faculty  / Program  - Program  costs  are  to  be  reported  for  each  program  for  which  Access  data  is 
provided.  Research  costs  are  to  be  reported  at  the  Faculty  level. 

Total  Program  Costs  - Are  to  be  determined  through  the  application  of  the  specific  costing  procedures 
set  out  in  the  following.  Total  program  costs  include  allocations  for  university  administration/support 
costs  and  for  public/community  services  activities. 

Research  Costs  - The  direct  (Faculty)  costs  associated  with  research  and  related  service  and  support 
activities  as  determined  through  application  of  the  specific  procedures  set  out  in  the  following. 
Research  costs  include  allocations  for  and  for  public/community  services  activities,  but  do  not  include 
university-wide  administration/support  costs. 


Costing  procedures  for  Universities: 

The  following  procedures  and  protocols  have  been  agreed  upon  by  the  universities  Fiscal  Management 
KPI  working  group  and  representatives  ofAECD.  They  provide  a general  framework  for  cost 
accounting  and  cost  allocation  that  can  be  applied  across  relatively  diverse  institutions  to  produce 
program  costs  that  are  sufficiently  comparable  for  the  purposes  of  KPI  reporting. 

To  meet  the  requirements  for  indicators  of  average  annual  costs  of  instructional  programs  per  student  in 
undergraduate  and  graduate  programs,  a methodology  has  been  developed  which  enables  the 
determination  of  average  costs  per  course,  which  are  used  to  accumulate  the  costs  of  all  courses  taken  by 
all  students  in  each  undergraduate  degree,  master’s  and  doctoral  program.  Graduate  supervision  costs 
where  applicable,  and  attributable  proportions  of  administration/support  (i.e.,  non-Faculty)  expenses  and 
public  (community  services)  costs,  are  added. 

1 . The  expenses  of  the  University  as  identified  in  its  Financial  Statements  are  divided  among  the 
teaching  Faculties,  Special  Sessions,  and  one  administration/support  category  that  includes  all  other 
operating  accounts. 
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2.  Faculty  costs  are  distributed  to  four  activity  categories:  (1)  course  instruction,  (2)  graduate  student 
supervision  in  support  of  the  program,  (3)  research,  and  (4)  public  or  community  service,  each  as 
defined  for  the  Faculty  Workload  indicators.  The  dean  of  the  Faculty  should  identify  this 
distribution  having  considered  the  following: 

• The  relevance  of  the  “percentage  time  spent”  data  (Faculty  Workload  Indicator)  on  at  least  the 
distribution  of  faculty  salary  and  related  costs.  (Note  that  the  definitions  provided  for  the  Faculty 
Workload  Indicator  should  also  be  used  here.) 

• The  allocations  to  course  instruction  and  graduate  student  supervision  will  be  reallocated  entirely 
to  the  support  of  student  programs  at  a later  stage  of  the  process.  Therefore,  for  example,  any 
expenses  related  to  interaction  and  collaboration  with  graduate  students  that  the  faculty  members 
would  deem  to  be  costs  of  the  research  program  of  the  faculty  members,  rather  than  costs  of  the 
graduate  program,  should  be  included  in  the  overall  percentage  for  the  research  program. 

• The  allocation  to  research  does  not  include  funds  received  through  research  grants  and  contracts. 
It  Is  intended  to  reflect  only  the  support  for  the  research  effort  provided  by  the  University’s 
operations  budget,  and  takes  Into  account  appropriate  portions  of  academic  and  other  staff 
salaries,  supplies,  and  so  on. 

• The  allocations  to  community  service  will  be  reallocated  to  student  programs  and  to  research  at  a 
later  stage  of  the  process  (see  Step  10). 

• The  allocation  percentages  for  the  four  activity  categories  should  add  up  to  100%.  Each  Faculty 
should  allocate  its  internal  administration/support  costs  in  keeping  with  the  extent  to  which  they 
relate  to  the  four  activity  categories. 

3.  The  total  costs  associated  with  teaching  in  the  Faculty  are  allocated  to  course  sections  taught  by  the 
Faculty  in  Winter  Session.  The  costs  of  Special  Sessions  (stipends  or  sessional  replacement  costs  of 
instructors)  are  allocated  to  sections  taught  in  the  Spring  and  Summer  Intersession,  May  to  August. 
The  sections  are  assigned  weights  corresponding  to  their  relative  costs. 

4.  The  cost  of  each  course  offered  by  the  Faculty  (or  Special  Sessions)  is  calculated  as  the  summation 
of  the  costs  of  each  section. 

5.  The  cost  of  each  Winter  Session  or  Intersession  course  is  divided  evenly  among  all  the  students 
registered  in  the  course.  Thus,  the  cost  allocated  to  a student  depends  on  the  number  and  type  of 
sections  of  that  course,  and  the  total  number  of  students  registered  in  the  course,  rather  than  on  the 
sizes  of  the  particular  sections  of  the  course  in  which  the  student  registered.  This  averaging  removes 
the  variations  that  could  occur  from  students  being  registered,  presumably  by  chance,  in  relatively 
larger  or  smaller  sections  of  the  course. 

6.  The  course  costs  attached  to  each  student  are  projected  to  the  actual  programs  of  the  students  as  a 
summation  across  all  courses  taken  by  student.  In  effect,  students  collect  course  costs  from  all 
faculties  from  which  they  take  courses. 

7.  The  graduate  supervision  costs  of  each  Faculty  are  allocated  to  graduate  programs  based  on  weighted 
enrolments  of  full-time  and  part-time  master’s  and  doctoral  students. 

8.  The  teaching,  graduate  supervision,  research,  and  public/community  service  costs  of  every  teaching 
Faculty  are  allocated  to  activities  and  eventually  to  programs  by  the  same  method.  The  instruction 
and  graduate  supervision  costs  of  each  student  program  are  increased  by  contributions  from  all 
faculties  that  serve  that  program. 

9.  The  total  administrating/support  costs  (i.e.,  non-Faculty  expenses)  are  allocated  to  three  activities  by 
overall  proportions  with  the  proportions  disclosed  In  notes  accompanying  reports. 
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10.  Public/community  services  costs  are  reallocated  back  to  instruction  (student  programs)  and  research 
on  a dollar  pro-rata  basis  and  then  across  programs  on  an  FLE  enrolment  basis. 

1 1 . The  administration/support  costs  attributable  to  instruction  are  allocated  to  student  programs  based 
on  weighted  student  enrolments.  Intersession  enrolments  are  assigned  weights  equal  to  one-half  of 
the  weights  of  corresponding  part-time  Winter  Session  enrolments.  Doctoral  and  Master’s  students 
are  weighted  more  heavily  than  undergraduates  for  the  purposes  of  this  allocation,  reflecting  the 
judgment  that  graduate  students  place  a greater  load  per  capita  on  the  infr astmcture  of  the  University 
than  do  undergraduates.  (Alternately,  these  costs  may  have  been  allocated  to  Faculties  at  an  earlier 
stage  of  the  process.) 

12.  The  average  cost  per  student,  per  year  of  each  program  is  calculated  by  dividing  total  program  costs 
by  the  FLE  enrolment  in  the  program.  The  enrolment  data  used  for  these  and  earlier  calculations  will 
be  that  reported  for  the  Access  indicator  and  cost  information  will  need  to  be  provided  for  each 
program  for  which  FLE  enrolment  data  is  provided. 


Specifications  & Protocols  - Private  University  Colleges: 

Program  and  Full-load  Equivalent  Enrolment  data  will  be  drawn  from  CIS  data.  Total  Program  Costs  are 
to  be  determined  in  accordance  with  the  costing  procedures  set  out  in  the  following  and  entered  through 
KPIRS. 


Costing  procedures  for  Private  University  Colleges: 

The  costing  procedures  for  private  colleges  are  adapted  from  those  for  universities,  eliminating  the  steps 

not  required  for  this  institutional  sector. 

1 . The  expenses  of  the  institution  as  identified  in  its  Financial  Statements  are  divided  among  the 
teaching  units  and  one  administration/support  category  that  includes  all  other  operating  accounts. 

2.  The  total  costs  associated  with  teaching  are  allocated  to  course  sections  taught.  The  course  sections 
are  assigned  weights  corresponding  to  their  relative  costs. 

3.  The  cost  of  each  course  offered  is  calculated  as  the  summation  of  the  costs  of  each  course  section. 

4.  The  cost  of  each  course  is  divided  evenly  among  all  the  students  registered  in  the  course.  Thus,  the 
cost  allocated  to  a student  depends  on  the  number  and  type  of  sections  of  that  course,  and  the  total 
number  of  students  registered  in  the  course,  rather  than  on  the  sizes  of  the  particular  sections  of  the 
course  in  which  the  student  registered.  This  averaging  removes  the  variations  that  could  occur  from 
students  being  registered,  presumably  by  chance,  in  relatively  larger  or  smaller  sections  of  the  course. 

5.  The  course  costs  attached  to  each  student  are  projected  to  the  actual  programs  of  the  students  as  a 
summation  across  all  courses  taken  by  student.  In  effect,  students  collect  course  costs  from  all 
teaching  units  from  which  they  take  courses. 

6.  The  administration/support  costs  are  allocated  to  student  programs  in  proportion  to  the  direct  costs 
accumulated  for  each  program. 

7.  The  average  cost  per  student,  per  year  of  each  program  is  calculated  by  dividing  total  program  costs 
by  the  FLE  enrolment  in  the  program.  The  enrolment  data  used  for  these  and  earlier  calculations  will 
be  that  reported  for  the  Access  (FLE  Enrolment)  indicator  and  cost  information  will  need  to  be 
provided  for  each  program  for  which  FLE  enrolment  data  is  provided. 
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Reconciliation  with  Total  Operations  Expenditures 

The  following  format  is  to  be  used  to  reconcile  the  institutional  total  of  the  Total  Program  Costs,  with 
Total  Institutional  Expenditures  as  per  the  data  reported  through  FIRS  for  the  corresponding  fiscal  year. 
This  reconciliation  format  includes  information  required  by  AECD  to  determine  that  standing  policies 
with  respect  to  Ancillary  Services  and/or  overheads  allocation  and  recovery  are  being  met,  and  to  ensure 
that  costs  not  greater  than  revenue  amounts  are  being  excluded  where  revenues  are  generated  from 
“byproducts  of  instruction”.  Information  on  brokered  programs  is  also  required  to  determine  the  level  of 
expenditure  on  students  officially  reported  by  another  institution.  These  costs,  on  a program  by  program 
basis,  are  then  associated  with  the  enrolment  that  you  report  in  CIS  as  being  shared  with  the  brokering 
partners.  The  shared  FLE  sure  currently  used  by  the  department  for  the  Access  indicator  to  measure 
growth  in  enrolment  from  a base  year. 


Reconciliation  of  Total  Program  Costs 
with  Total  Expenditures 

RecohciliatJott 

Overheads,  etc. 
included  in 

excluded 

Revenue 
amounts  where 
relevant 

Total  Expenditures  as  per  Financial  Statements  j 

Less  such  items  as: 

r ::i 

Ancillary  enterprises 

By-products  of  instruction  (colleges  & technical  institutes) 

Direct  non-sponsored  research  costs  (universities) 

Administrative  / support  costs  allocated  to  non-sponsored  research 
Non-credit  costs 

Sponsored  research  (universities) 

Special  purpose,  trust  and  endowment 

Brokered  programs  (specify): 

Other  (specify) 

Plus:  Additions,  if  any  (specify) 

Total  Program  Costs 

i i .... i . .... 

r ~ i 
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COST  per  GRADUATE  (Program  Completer) 


The  average  cost  per  graduate  (program  completer)  is  a measure  of  unit  costs  used  to  indicate 
that  resources  are  used  efficiently  and  that  costs  are  comparable  to  those  for  similar  programs  at 
other  institutions  of  comparable  size,  location  and  function. 


Indicator(s)  Apply  to: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

Average  cost  per  graduate  (program 

completer)  XXX 


Level  of  Reporting:  By  program. 

Colleges  & Technical  Institutes  - at  CIS  ProgID  level. 

Vocational  Colleges  - at  CIS  Standard  Name  level,  by  program  length. 
Universities  - at  CIS  Standard  Name  level,  by  program  length. 

Private  University  Colleges  - at  CIS  Standard  Name  level,  by  program 
length. 

Scope:  Information  required  for  all  parchment  program  types:  Skill  Training, 

Trade  Certificate,  Certificate,  Diploma,  Other  Career  (Post-Certificate), 
Applied  Degree,  Bachelor  Degree,  Masters  Degree  and  Ph.D. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Program  identification  data 

CIS 

KPIRS* 

CIS 

Aggregate  costs  for  graduates  (program 

KPIRS 

KPIRS 

KPIRS 

completers) 

Number  of  graduates  (program  completers) 

CIS 

KPIRS  * 

CIS 

Average  cost  per  graduate  (program 

completer) 

KPIRS 

KPIRS 

KPIRS 

* The  University  of  Lethbridge  data  for  these  elements  will  be  drawn  from  CIS. 


Specifications  & Protocols: 

Number  of  Program  Completers  - The  total  number  of  students  who  have  been  determined  by  the 
institution  to  have  completed  all  program  requirements  and  to  whom  the  institution  would  therefore 
confer  a parchment  where  a parchment  is  offered,  during  the  reporting  year  for  which  a costing  is 
performed.  Data  for  the  number  of  program  completers  is  reported  through  CIS  by  Colleges  and 
Technical  Institutes  and  Private  University  Colleges. 

Aggregate  Costs  for  Program  Completers  - The  total  costs,  including  direct  and  indirect  costs  and 
overheads,  attributable  to  those  students  who  complete  programs  in  a reporting  year,  taking  into 
account  the  costs  of  all  courses  taken  and  services  provided  to  each  student  over  all  years  of  enrolment 
leading  to  completion  of  the  program,  calculated  in  accordance  with  the  procedures  and  protocols 
described  in  the  following.  These  data  will  be  prepared  by  institutions  and  reported  through  KPIRS. 
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Average  Cost  per  Program  Completer  - The  Aggregate  Costs  for  Program  Completers  divided  by  the 
Number  of  Program  Completers.  This  will  be  calculated  by  KPIRS. 


Costing  procedures  for  Colleges  & Technical  Institutes: 

Two  methods  of  calculating  average  costs  per  graduate  (completer)  of  “parchment”  programs  are 
acceptable:  a “course-based”  method  and  an  “FLE-based”  method. 

Course-based  Method 

This  method  involves  allocating  program  and  overhead  expenditures  down  as  far  as  the  level  of 
individual  courses  in  the  institution’s  Calendar.  Costing  procedures  are  similar  to  the  program  costing 
models  already  documented,  but  with  a “subroutine”  that  calculates  an  average  cost  per  course  registrant 
for  all  courses  in  a discipline,  or  offered  by  an  instructional  unit,  or  for  groupings  of  courses  (i.e.  first 
year  or  level,  second  year  or  level,  etc.),  or  for  individual  courses  if  desired.  Indirect  or  “overhead”  costs 
are  distributed  to  these  courses  or  groupings  in  a manner  similar  to  the  program  costing  model.  The 
process  is  repeated  for  each  of  the  years  in  which  the  program  completers  were  taking  courses  (the  1994- 
95  costs  may  be  used  as  proxies  for  prior  year  costs).  The  resulting  “course  level”  costs  are  used  to 
produce  cumulative  costs  based  on  the  registration  records  of  individual  graduates.  This  model  will 
produce  a reasonably  accurate  aggregation  of  costs  for  all  the  completers  of  a program,  which  is  then 
divided  by  the  number  of  completers  to  produce  an  average  cost  per  completer.  The  course-based 
method  may  be  a preferable  alternative  for  institutions  who  have,  or  may  wish  to  build  a course  cost 
database  for  internal  management  information  purposes. 


FLE-based  Method 

The  FLE-based  method  relies  more  directly  on  the  costing  model  outlined  above  (for  Cost  per  Student, 
Cost  per  SCH)  which  produces  a Cost  per  FLE  Enrolment  for  each  for  each  program  at  the  CIS  ProgID 
level.  [AVCs  will  use  the  Standard  Name  level.]  From  the  CIS  data  base,  FLE  values  are  produced  for 
each  student,  for  each  year  of  the  student’s  enrolment  leading  to  completion  of  a program.  Accumulating 
these  values  over  the  years  produces  a total  which  can  be  regarded  as  the  student’s  degree  of  cumulative 
involvement  at  the  institution.  For  any  KPI  reporting  year,  the  FLEs  generated  by  the  set  of  completers 
in  each  program  are  cumulated  across  all  sessions  and  years  in  which  any  of  the  students  in  the  completer 
group  were  registered.  Applying  the  relevant  unit  costs  (Cost  per  Student)  for  each  program  and  each 
year  will  produce  an  Aggregate  which  should  approximate  that  which  would  have  resulted  from  the  more 
detailed  course-based  method. 

Sample  calculation  using  the  FLE-based  method: 

Student  “A”  graduates  in  the  1994-95  academic  year  from  Agricultural  Technology  and  again  in 
1995-96  from  Computer  Technology. 

FLE  History: 

“A”  started  in  1990  in  the  Business  diploma  program  = .40  FLE 
In  1991  “A”  switched  over  to  Computer  Technology  = .30  FLE 
In  1992  “A”  switched  to  Agricultural  Technology  = .60  FLE 

1993  Agricultural  Tech  = .60  FLE 

1994  Agricultural  Tech  = .80  FLE 

1995  Computer  Technology  = .60  FLE 

Total  FLE  value  in  Agricultural  Tech:  2.0  FLE 
Total  FLE  value  in  Computer  and  Business  =1.3 
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The  1994-95  Cost  per  Student  for  Agricultural  Technology  is  $10,000/FLE  - multiply  that  number 
by  2.0  to  derive  the  Cost  per  Completer.  In  this  example  then,  the  cumulative  cost  [aggregate  cost] 
for  the  completer  would  be  $10,000  x 2 = $20,000,  if  the  FLE  in  Business  and  Computer  Technology 
is  not  included.  If  there  was  only  one  graduate,  then  your  average  cost  per  grad  would  be  $20,000. 

Now,  if  student  “A”  returns  to  school  in  1995  to  complete  Computer  Technology,  the  1991  would  be 
combined  with  the  1995  FLE  and  even  the  1990  Business  FLE  might  be  included.  If  the  Cost  per 
Student  in  Computer  Technology  = $1 1,000  and  in  Business  $8,000  then  the  1995-96  aggregate  cost 
for  Computer  Technology  [just  one  grad]  would  be  (.90  FLE  x $1 1,000  = $9900)  + (.40  FLE  x 
$8,000  =$3,200)  = $13,100. 


FLE  Enrolment 

Academic  Year 

ProaiD 

Total 

Cost  / FLE  : 

Aaareaate  Cost 

1990 

BUS 

0.4 

$ 8,000 

$ 

3,200 

1991 

CT 

0.3 

$ 11,000 

$ 

3,300 

1992 

AT 

0.6 

$ 10,000 

$ 

6,000 

1993 

AT 

0.6 

$ 10,000 

$ 

6,000 

1994 

AT 

0.8 

$ 10,000 

$ 

8,000 

1995 

CT 

0.6 

$ 11,000 

$ 

6,600 

Grand  Total 

3.3 

$33,100 

Total  FLE  value  in  BUS 

0.4 

$ 8,000 

$ 3,200 

Total  FLE  value  in  CT 

0.9 

$ 11,000 

$ 9,900 

Total  FLE  value  in  AT 

2.0 

$ 10,000 

$20,000 

Graduates 

Aaareaate  Cost 

Cost / Grad 

1 1995*96  CT 

1 

$ 13,100 

$ 13,100 

A few  things  to  note: 

(1)  Use  the  1994-95  Cost  per  Student  as  a proxy  value  for  earlier  years,  since  these  data  are  not 
likely  to  be  available  for  earlier  years. 

(2)  When  applying  the  FLE  method,  some  judgments  about  how  to  allocate  the  time  spent  by  a 
graduate  in  programs  (ProgIDs)  other  than  the  one  from  which  the  student  graduated  are  required.  In 
this  example,  by  excluding  FLEs  in  Business  and  Computer  Technology,  the  institution  regards  the 
students’  time  in  these  programs  as  not  contributing  to  any  of  the  course  requirements  for 
Agricultural  Technology  or  preparing  the  student  for  entering  the  program.  Furthermore,  these 
Computer  and  Business  FLEs  may  be  part  of  another  program  costing,  as  shown  in  the  example. 
FLEs  in  a previous  program  should  only  be  used  toward  the  costing  of  one  completion  except  in  the 
case  where  completion  of  another  year  of  study  provides  a second  parchment  for  the  same  program, 
i.e.  where  certificate  granted  for  one  year  of  study,  and  a diploma  after  two. 

Some  judgment  is  involved  in  deciding  which  part  of  a student’s  history  to  include  in  the  costing  of 
the  student’s  parchment  completion  but  THIS  IS  NOT  UNIQUE  TO  THE  FLE-BASED  METHOD. 
Similar  judgment  calls  are  involved  in  using  the  course  based  method:  Which  courses,  if  not  all,  on 
the  student’s  transcript  contributed  in  some  way  to  completion  of  the  parchment  program? 

(3)  A student  may  have  been  registered  in  a number  of  different  ProgIDs  prior  to  completing  a 
program.  For  example,  some  programs  have  separate  ProgIDs  for  different  year  2 streams,  others  for 
years  1 and  2 of  the  “program”.  There  are  several  other  reasons.  Many  students  change  their  minds 
about  their  fields  of  study.  Also  students  in  UT,  or  general  studies,  or  preparatory  programs  may 
complete  courses  that  eventually  help  them  to  complete  a parchment  program  at  your  institution.  In 
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all  such  cases  there  will  be  more  than  one  ProgID  that  contributes  to  the  student’s  cumulative  FLE 
and  cost. 

(4)  In  order  to  calculate  cost  per  completer  using  the  FLE  method  you  need  the  historical  FLE 
enrolment  values  for  program  completers.  This  will  assist  you  in  determining  the  cumulative  FLE  of 
each  student  who  completed  a parchment  program  during  the  academic  year.  (A  database  of  FLEs 
traced  back  to  1989  for  all  graduates  of  parchment  programs  is  available  through  CIS.  You  can 
contact  AECD’s  System  Information  branch  to  request  this  information  if  you  have  not  already 
received  it.) 

Costing  procedures  for  Universities  and  Private  University  Colleges: 

Detailed  methodology  for  calculating  the  average  cost  per  graduate  is  under  development.  This 
methodology  will  provide  for  the  calculation  of  average  cost  per  graduate  based  on  the  actual  programs 
of  individual  students  and  the  costs  of  providing  the  courses  that  each  has  taken.  The  following  main 
steps  will  be  involved: 

1 . Calculate  costs  per  course  registration  for  the  period  over  which  the  student(s)  with  the  longest 
“transcript  history”  have  taken  courses.  These  costs  will  be  calculated  in  a manner  similar  to  that  set 
out  in  steps  1 through  6 of  the  Costing  Procedures  for  Universities  set  out  for  the  Program  Costs 
indicator  (see  Page  68).  Institution-wide  administration/support  and  public/community  services 
allocations  should  be  made  at  this  stage  of  the  process. 

2.  Identify  “cohorts”  of  graduates  by  program  and  transfer  status.  (Other  “streams”  may  be  identified.) 

3.  Determine  a cost  per  graduate  based  on  the  transcript  of  each  graduate. 

4.  Average  the  costs  per  graduate  across  a “cohort”  to  obtain  the  average  cost  per  graduate  for  the 
transfer,  non-transfer  and  other  streams  which  may  have  been  identified. 
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SPACE  UTILIZATION 


The  Space  Utilization  indicator  provides  general  measures  of  the  intensity  of  utilization  of 
classroom  and  class  laboratory  facilities  for  credit  instruction,  non-credit  activities  and 
community  services. 


Indicator(s)  Apply  to: 

Colleges  & Technical 

Universities 

Private  University 

institutes 

Colleges 

Average  classroom  hours  per  week 

X 

Not 

- 

Average  class  laboratory  hours  per  week 

X 

currently 

- 

Average  classroom  hours  as  % of  50 

X 

reported 

- 

Average  class  laboratory  hours  as  % of  40 

X 

- 

Level  of  Reporting:  By  institution  at  the  total  institution  level. 

Scope:  Information  required  for  credit  and  non-credit  instructional 

programming,  and  community  services  activities. 

■mmssmmmmmmmmsm 

Data  Elements  & Reporting  Systems: 

C&kge  : : 

Universities 

Private  University 

l > ..  ' k : 

Colleges 

Data  reported  through  (or  calculated  by) 

Average  classroom  hours  per  week 

July  / August  (Summer) 

Credit  instruction 

KPIRS 

- 

- 

Non-credit  instruction 

KPIRS 

- 

- 

Conununity  service 

KPIRS 

- 

- 

September  / April  (Winter) 

Credit  instruction 

KPIRS 

- 

- 

Non-credit  instruction 

KPIRS 

- 

- 

Community  service 

KPIRS 

- 

- 

May  / June  (Spring) 

Credit  instruction 

KPIRS 

- 

- 

Non -credit  instruction 

KPIRS 

_ 

- 

Community  service 

KPIRS 

- 

- 

Average  classroom  hours  per  week  as  % of  50 

July  / August  (Summer) 

Credit  instruction 

KPIRS 

- 

- 

Non-credit  instruction 

KPIRS 

- 

- 

September  / April  (Winter) 

Credit  instruction 

KPIRS 

- 

- 

Non -credit  instruction 

KPIRS 

- 

- 

May  / June  (Spring) 

Credit  instruction 

KPIRS 

- 

- 

Non-credit  instruction 

KPIRS 

- 

- 

Average  class  laboratory  hours  per  week 

July  / August  (Summer) 

KPIRS 

- 

- 

September  / April  (Winter) 

KPIRS 

- 

- 

May  / June  (Spring) 

KPIRS 

- 

- 

Average  class  lab.  hours  per  week  as  % of  40 

July  / August  (Summer) 

KPIRS 

- 

- 

September  / April  (Winter) 

KPIRS 

- 

- 

May  / June  (Spring) 

KPIRS 
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Specifications  & Protocols: 

Average  Classroom  Hours  per  Week  and  Average  Class  Lab.  Hours  per  Week,  from  institutional  records, 
to  be  entered  through  KPIRS.  ACH  per  Week  as  % of  50,  and  ACLH  per  Week  as  % of  40  are 
calculated  by  KPIRS. 

Classrooms  - Rooms  used  for  classes,  that  are  not  tied  to  a specific  subject  or  discipline  by  equipment 
in  the  room  or  the  configuration  of  the  room.  Includes  lecture  rooms,  seminar  rooms,  general-purpose 
classrooms  which  may  include  multimedia  and  telecommunication  equipment  used  in  a specific  area 
of  study,  or  may  be  specially  configured,  if  this  equipment  or  special  configuration  does  not  render  the 
space  unsuitable  for  use  by  other  areas  of  study.  Does  not  include  Conference  Rooms,  Meeting 
Rooms,  Auditoria  (unless  used  primarily  for  scheduled  classes),  or  Class  Laboratories. 

Class  Laboratories  - Rooms  used  primarily  for  formally  or  regularly  scheduled  classes  that  require 
special  purpose  equipment  or  a specific  room  configuration,  for  student  participation,  practice  in  a 
subject  of  study.  The  special  equipment  or  configuration  will  usually  limit  or  preclude  use  by  other 
areas  of  study.  Includes  teaching  laboratories,  shops,  machine  or  computer  laboratories,  drafting 
rooms,  band  rooms,  choral  rooms,  group  practice  rooms,  language  labs,  group  studios,  theatre  stage 
areas  and  other  performance  spaces  or  similar  rooms.  Does  not  include  gymnasia,  swimming  pools, 
demonstration  schools,  day  care  facilities,  and  other  Special  Use  facilities,  computer  rooms  in 
libraries  or  rooms  used  primarily  for  study. 

Average  Classroom  Hours  per  Week  - The  average  number  of  hours  per  week  that  classrooms  are  used 
for  scheduled  instructional  activity  or  institutionally  organized  or  sanctioned  group  activities  related 
to  instruction  or  public/community  service.  Sources  of  data  will  depend  upon  institutional 
organization  and  managerial  structures  for  scheduling  and  use  of  facilities.  The  method  of 
determination  should  enable  the  aggregation  of  hours  of  use  for  all  classrooms  for  all  days  of  all 
weeks  of  the  July/ August  period,  the  September  through  April  period  and  the  May/June  period  of  the 
academic  calendar,  and  the  calculation  of  an  average  number  of  hours  per  week  per  classroom  for 
each  period.  Activities  related  to  public/community  service  should  be  separately  identified. 
Commercial  rentals  of  facilities  should  be  excluded.  “Commercial”  covers  those  rentals  where  the 
relationship  between  the  college  and  the  renter  is  purely  commercial  and  has  no  relationship  to  the 
instructional  or  public  services  mandates  of  the  college. 

Average  Class  Laboratory  Hours  per  Week  - Procedures  are  similar  to  those  for  classrooms.  Hours  of 
individual  student,  casual  and/or  non-scheduled  use  of  class  laboratories  should  be  included  where  the 
specialized  equipment,  facilities  or  configuration  of  the  lab  is  required  for  the  purposes  of  use  or  the 
users  are  supervised  or  monitored. 

Specialized  spaces  which  cannot  be  used  for  other  purposes  should  be  recorded  as  being  used  for  14 
hours  per  day,  5 days  per  week  (=70  hours/week).  This  provision  is  not  intended  to  cover  ordinary 
laboratories  (e.g.  chemistry,  computer).  It  is  intended  to  provide  for  those  very  rare  situations  in 
which  a ridiculously  low  usage  rate  would  result  simply  because  the  equipment  is  so  very  specialized 
or  the  accommodations  are  such  that  the  lab  can  be  used  by  only  a very  few  classes  for  a very  short 
time. 

ACH  per  Week  as  % of  50  ( Classrooms)  / 40  ( Class  Labs)  - Initial  utilization  levels  of  50  and  40  hours 
per  week  have  been  set  as  benchmarks  for  average  utilization  for  classrooms  and  class  laboratories. 
These  may  need  to  be  adjusted  in  the  future  as  patterns  of  use  and  norms  are  established. 

Example  Calculation : 

Assume  that  a “small”  college  has  three  classrooms.  Classroom  #1  is  scheduled  for  30  class  hours  per 
week  for  16  weeks  in  each  of  the  Fall  and  Winter  sessions,  with  no  other  use.  Classroom  #2  is  scheduled 
for  35  class  hours  per  week  (16  weeks  in  Fall  and  16  weeks  in  Winter),  and  is  used  for  an  additional  300 
hours  over  the  September  through  April  period  for  a variety  of  activities  (recorded  somewhere,  we  hope). 
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Classroom  #3  is  scheduled  for  45  class  hours  per  week  over  the  32  weeks  of  the  regular  schedule  and  is 
used  for  an  additional  400  hours. 

What  might  be  termed  “aggregate  classroom  hours”  for  the  three  rooms  over  the  September  through 
April  period  comes  to  4,220.  In  1994-95  there  were  34.57  calendar  weeks  (34  weeks  and  4 days)  from 
September  1 through  April  30.  The  average  number  of  hours  of  use  per  room  per  week  can  be  calculated 
to  be  40.7  by  dividing  the  aggregate  classroom  hours  by  34.57  and  the  result,  in  turn,  by  3. 

To  perform  this  calculation  for  any  period  and  any  number  of  rooms  the  following  data  is  needed: 

- the  aggregate  number  of  hours  that  all  rooms  are  used 

- the  total  number  of  rooms 

- the  number  of  calendar  weeks  in  the  period 

The  latter  are:  My  / August  1994  - 8.86;  September  / April  1995  - 34.57;  May  / June  - 8.71.  (Note  that 
a 365  day  year  has  52.14  weeks!) 

There  will  be  various  ways  of  aggregating  the  number  of  hours  that  classrooms  or  class  laboratories  are 
used,  depending  on  the  scheduling,  booking  and  recording  systems  in  use  at  various  institutions.  A 
“matrix”  will  not  always  be  required  (i.e.,  the  utilization  calculations  may  not  be  needed  for  each  room), 
but  some  method  will  need  to  be  developed  to  arrive  at  the  aggregate  total  hours  of  use  of  all  rooms. 
Where  data  is  not  available  and  estimates  are  made,  the  basis  for  estimating  will  need  to  be  disclosed 
and,  in  the  future,  since  KPI  reporting  will  be  subject  to  some  kind  of  audit  process,  documentation  will 
need  to  be  maintained. 
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REVENUE  - RELATED  INDICATORS 


The  following  revenue-related  indicators  will  be  reported  at  the  institutional  level: 

• AECD  grants  per  FLE  enrolment 

• AECD  grants  as  a percentage  of  total  operations  revenues 

• tuition  fees  per  FLE  enrolment 

• other  revenues  per  FLE  enrolment 

• enterprise  revenues  as  a percentage  of  AECD  grants 


Indicator(s)  Apply  to: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

AECD  grants  per  FLE  enrolment 

AECD  grants  as  % of  total  operations 

X 

X 

X 

revenues 

X 

X 

X 

Tuition  fees  per  FLE  enrolment 

X 

X 

X 

Other  revenues  per  FLE  enrolment 

X 

X 

X 

Enterprise  revenues  as  % of  AECD  grants 

X 

X 

X 

Level  of  Reporting:  By  institution  at  the  total  institution  level. 

Scope:  All  institutions. 

,.sWy.m^ 

Data  Elements  & Reporting  Systems: 

Colleges  & Technical 

Universities 

Private  University 

Institutes 

Colleges 

Data  reported  through  (or  calculated  by) 

AECD  grants 

FIRS 

FIRS 

FIRS 

Tuition  fees 

FIRS 

FIRS 

FIRS 

Other  revenues 

FIRS 

FIRS 

FIRS 

Enterprise  revenues 

FIRS 

FIRS 

FIRS 

Total  operations  revenues 

FIRS 

FIRS 

FIRS 

FLE  enrolment 

CIS 

KPIRS  * 

CIS 

* The  University  of  Lethbridge  data  for  this  element  will  be  drawn  from  CIS. 

Specifications  & Protocols: 

Financial  data  for  Revenue-Related  indicators  are  reported  through  the  Financial  Information  and 
Reporting  System  (FIRS)  using  a comprehensive  system  of  classifications  and  definitions  which  has  been 
developed  for  all  general  financial  information  reporting  to  Alberta  Advanced  Education  and  Career 

Development.  The  following  definitions  and  functional  classifications  are  used  for  Key  Performance 
Indicator  data.  No  reporting  of  this  data  is  required  through  KPIRS. 


Year  - For  Colleges  & Technical  Institutes,  the  CIS  enrolment  data  reporting  year  and  the  fiscal  year 
coincide  (July  through  June).  For  Universities  and  Private  University  Colleges,  enrolment  data  for  a 
May  through  April  reporting  year  will  be  matched  to  financial  data  for  a corresponding  April  through 
March  fiscal  year. 
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AECD  grants  - Includes  unrestricted  grants  from  AECD  which  fund  program  delivery  and 
administration,  and  general  capital  requirements  within  each  institution's  mandate  (General 
Operations  Grants),  grants  provided  through  “envelopes”  established  as  part  of  the  AECD  Funding 
Mechanism  (Envelope  Grants)  and  grants  for  specific  programs  or  purposes  which  may  be  restricted 
and/or  may  involve  special  terms,  conditions,  accounting  and/or  funds  management  requirements 
(Conditional  Grants). 

Tuition  fees  - Credit  tuition  & related  fees.  Includes  tuition  revenues  from  students,  or  paid  on  behalf  of 
students,  that  result  from  the  assessment  of  fees  for  instruction  in  credit  programs  and  courses  and 
universal  fees  (library  fees,  computer  services,  materials  and  other  similar  fees  or  charges)  paid  by  all 
students,  not  specific  to  courses,  programs  or  the  extent  of  use  of  a service  or  quantity  of  materials 
used. 

Other  Revenues  - Total  operations  revenues  (total  revenues  less  ancillary  enterprises,  sponsored 
research,  and  special  purpose  and  trust  revenues)  less  AECD  grants  less  tuition  fees. 

Total  operations  revenues  - Total  revenues  for  a fiscal  year  as  reported  in  the  financial  statements  of  an 
institution,  less  Ancillary  Enterprises,  Sponsored  Research,  and  Special  Purpose  and  Trust  revenues. 

Enterprise  revenues  - Total  revenues  less  all  government  grants,  tuition  fees  subject  to  AECD  tuition 
policy,  ancillary  enterprises  revenues,  earned  capital  contributions,  and  sponsored  research  revenues 
(universities).  Includes  all  Contract  Credit  and  Non-credit  revenues  and  all  revenues  in  the  Other 
Revenue  type,  including  Other  Alberta  Sources,  Other  Government  Sources,  Other  Public  Sources, 
Private  Sources,  Gifts  & Donations,  Investment  Revenues  and  Other  Sources. 

Full-load  equivalent  enrolment  - Full-load  equivalent  enrolment  as  defined  and  reported  for  the  Access 
indicator  information  set  (through  CIS  where  the  data  is  available).  FEE  enrolment  data  will  be 
drawn  from  CIS  data. 


The  following  indicators  are  calculated  by  KPIRS: 

AECD  grants  / total  operations  revenue  - Total  AECD  grants  expressed  as  a percentage  of  total 
operations  revenues. 

AECD  grants  per  FLE  enrolment  - Total  AECD  grants  for  a fiscal  year  divided  by  the  full-load 
equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Tuition  fees  per  FLE  enrolment  - Tuition  fee  revenues  for  a fiscal  year  divided  by  the  full-load 
equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Other  revenues  per  FLE  enrolment  - Total  operations  revenues  (total  revenues  less  ancillary  enterprises, 
sponsored  research,  and  special  purpose  and  trust  revenues)  less  AECD  grants  less  tuition  fees  divided 
by  the  full-load  equivalent  enrolment  for  the  corresponding  enrolment  reporting  year. 

Enterprise  revenues  as  % of  AECD  grants  - Enterprise  revenues  expressed  as  a percentage  of  total 
grants  from  Alberta  Advanced  Education  and  Career  Development. 
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EXPENDITURE  - RELATED  INDICATORS 


The  following  expenditure-related  indicators  will  be  reported  at  the  institutional  level: 

• Instruction  expenditures  as  a percentage  of  total  operations  expenditures 

• the  total  of  Academic  Support  and  Student  Services  expenditures  as  a 
percentage  of  total  operations  expenditures 

• Institutional  support  (administration)  expenditures  as  a percentage  of  total 
adjusted  expenditures 


msssssmmmmmmmmmsmmms 


Indicator(s)  Apply  to:  j Colleges  <£  Technical 

1 : Institutes 

Universities 

Private  University 
Colleges 

Instraction  expenditures  as  % of  total 
operations  expenditures  X 

X 

X 

Academic  support  and  student  services 
expenditures  as  % of  total  operations 
expenditures  X 

X 

X 

Institutional  support  expenditures  as  % of  total 
adjusted  expenditures  X 

X 

X 

3SSSS3S9SSSSSS3SSS9SSSSSSSSSSSSSSSSSSSSSSSS9SS& 

Level  of  Reporting : By  institution  at  the  total  institution  level. 

Scope:  All  institutions. 


nnmnmn 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University  | 

iiiHHai 

Date  reported  Mmugh  (or  cafeotaiedby) 

Instraction  (&  non-sponsored  research) 

expenditures 

FIRS 

FIRS 

FIRS 

Academic  support  & student  services 

expenditures 

FIRS 

FIRS 

FIRS 

Total  operations  expenditures 

FIRS 

FIRS 

FIRS 

Institutional  support  (administration) 

expenditures 

FIRS 

FIRS 

FIRS 

Total  adjusted  expenditures 

FIRS 

FIRS 

FIRS 
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Specifications  & Protocols: 

Financial  data  for  Expenditure-Related  indicators  are  reported  through  the  Financial  Information  and 

Reporting  System  (FIRS)  using  a comprehensive  system  of  classifications  and  definitions  which  has  been 

developed  for  all  general  financial  information  reporting  to  Alberta  Advanced  Education  and  Career 

Development  The  following  functional  classifications  are  used  for  Key  Performance  Indicator  data.  No 

reporting  of  this  data  is  required  through  KPIRS. 

Year  - For  Colleges  & Technical  Institutes,  the  CIS  enrolment  data  reporting  year  and  the  fiscal  year 
coincide  (July  through  June).  For  Universities  and  Private  University  Colleges,  enrolment  data  for  a 
May  through  April  reporting  year  will  be  matched  to  financial  data  for  a corresponding  April  through 
March  fiscal  year. 

Total  operations  expenditures  - Total  expenditures  for  a fiscal  year  as  reported  in  the  financial 
statements  of  an  institution,  excluding  Ancillary  Enterprises,  Sponsored  Research  (universities  and 
private  colleges),  and  Special  Purpose  and  Trust  expenditures. 

Instruction  expenditures  - Expenditures  by  and  through  cost  centres  and  budgetary  units  directly  and 
primarily  engaged  in  the  delivery  of  the  institution’s  instructional  programs. 

Academic  support  & student  services  expenditures  (total)  - Academic  support  includes  expenditures  by 
and  through  cost  centres  and  budgetary  units  that  directly  support  primary  functions;  and  activities 
which  directly  support  academic  functions  such  as  course  and  curriculum  development  activities  and 
academic  personnel  development.  Includes:  Libraries  (central  and  branch).  Museums  and  Galleries, 
Academic  Administration  (deans  and  directors,  departments  heads,  chairs  and  associated  staff  and 
functions),  Course  and  Curriculum  Development  (future  oriented  - relating  to  more  than  one  faculty 
or  program  division  - not  current  year  changes),  and  Academic  Personnel  Development.  Student 
services  includes  expenditures  by  or  through  units  that  provide  admissions  and  registry  functions  and 
activities  that  support  the  student  body  or  provide  services  to  individual  students  or  student  groups: 
Student  Service  Administration  (including  activities  that  cut  across  student  services  sub-functions), 
Student  Recruitment,  Admissions  and  Records  (admissions,  registrar  & related).  Counseling, 
Placement  and  Career  Guidance  (central  student  services,  not  academic  or  program  counseling  at  the 
faculty  or  program  level,  Social  Development  and  Recreation  Financial  Aid  Administration,  and 
Intercollegiate  Athletics. 

Institutional  support  (administration)  expenditures  - Expenditures  by  and  through  units  which  provide 
executive  management,  public  relations,  alumni  relations,  fund  raising  and  development,  corporate 
insurance  premiums,  general  administrative  services  and  any  other  institution- wide  administrative  services. 
Executive  management  includes  the  board,  president,  vice-presidents  and  associate  vice-presidents, 
corporate  planning  and  support  services  related  to  these  functions.  General  Administrative  Services 
includes  financial,  human  resources,  logistical  corporate  services  not  included  in  Executive  Management. 

Total  adjusted  expenditures  - Total  expenditures  for  a fiscal  year  as  reported  in  the  financial  statements 
of  an  institution,  excluding  Ancillary  Enterprises,  but  including  Sponsored  Research  (universities  and 
private  colleges),  and  Special  Purpose  and  Trust  expenditures. 


Notes: 

1 . Total  Operations  Expenditures  and  its  component  categories  above,  as  defined  in  FIRS,  include 
capital  amortization. 

2.  Costs  such  as  severance  pay  and  early  retirement  incentive  costs  are  included  in  Total  Operations 
Expenditures  as  recorded  in  institutional  financial  statements  and  reported  through  FIRS. 
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RESEARCH  - Intensity 

This  indicator  measures  the  intensity  of  research  in  relation  to  the  total  sphere  of  institutional 
activities.  The  indicator  is  structured  as  a research  “intensity”  ratio  relating  revenues  for 
sponsored  research  activities  to  provincial  operating  grant  support.  The  numerator  includes  all 
sponsored  research  revenues  - provincial  and  federal  government  and  non-profit  and  for-profit 
sectors;  the  denominator  is  die  province’s  undifferentiated  contribution  to  all  university 
functions  and  supports  salaries  for  faculty  and  other  staff  members  as  well  as  institutional 
infrastructure  including  facilities,  services,  library,  and  computing  support  for  research. 

Data  will  be  obtained  to  calculate  three  three-year  rolling  averages  for  each  Alberta  university 
(excluding  Athabasca  University),  and  for  “peer  group”  comparisons  with  similar  Canadian 
institutions:  


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
i Dalhousie  University 

University  of  Laval 

McGill  University 
•University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 

Queen’s  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 

Brandon  University 

Brock  University 

Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary’s  University 

Trent  University  i 

Wilfred  Laurier  University 
University  of  Winnipeg 

Indicators)  Apply  to: 

Sponsored  research  revenues  as  % of 
provincial  operating  grants 


Colleges  Technical 

Universities.-.  Private  University 

Institutes 

Colleges 

- 

X 

(except  Athabasca) 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  University  of  Alberta,  University  of  Calgary  and  University  of 

Lethbridge. 


Data  Elements  & Reporting  Systems: 


Sponsored  research  revenues 
Total  provincial  operating  grants 
Sponsored  research  revenues  as  % of 
provincial  operating  grants  - KPIRS 


Colleges  & Technical 
• Institutes 

Universities 

Private  University 
Colleges 

Bate  reported  through  (or  calculated  by) 

KPIRS 

KPIRS 
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Specifications  & Protocols: 

Total  sponsored  research  revenues  and  provincial  grants  are  reported  by  each  university  (Alberta 
universities  and  peer  group  institutions)  through  Statistics  Canada  and  the  Canadian  Association  of 
University  Business  Officers  (CAUBO)  using  definitions  and  formats  developed  by  the  latter,  and  should 
be  available  locally,  and  from  other  Canadian  universities,  through  CAUBO,  for  peer  group 
comparisons.  Use  of  this  source  for  both  the  Alberta  universities  and  peer  group  institutions  will  ensure 
a reasonable  level  of  comparability. 

Data  for  the  research  intensity  indicator  is  to  be  reported  through  KPIRS. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
should  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  is  maintained  for  a five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 

Sponsored  Research  Revenues  - Total  sponsored  research  revenues  from  federal,  provincial  and 
municipal  sources,  individuals,  profit  and  not-for-profit  organizations,  and  foundations,  including 
grants,  contracts  and  other  types  of  awards.  Normally  these  revenues  are  separate  and  segregated 
from  revenues  which  support  the  general  operations  of  the  university. 

Total  Provincial  Operations  Grants  - Grants  provided  through  AECD  including  the  general  operations 
grant  which  funds  program  delivery  and  administration,  and  general  capital  requirements  within  each 
institution’s  mandate;  grants  provided  through  “envelopes”  established  as  part  of  the  AECD  Funding 
Mechanism;  and  conditional  grants  for  specific  programs  or  purposes  which  may  be  restricted  and/or 
may  involve  special  terms,  conditions,  accounting  and/or  funds  management  requirements. 

Sponsored  Research  / Provincial  Operations  Grants  - Total  sponsored  research  revenues  expressed  as  a 
percentage  of  total  provincial  operations  grants. 


Athabasca  University: 

This  indicator  will  not  be  reported  for  Athabasca  University. 
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RESEARCH  - Publications  and  Other  Creative  Works 


Research  performance  can  be  reflected  by  the  “citation  impact”  of  research  papers  produced  by 
university  faculty  members.  The  degree  to  which  these  papers  contribute  to  and  influence  the 
field  or  fields  to  which  they  apply  is  reflected  by  the  citation  impact  of  these  papers.  The 
citation  impact  indicator  is  expressed  as  the  ratio  of: 

• number  of  citations  received 

• number  of  publications  reported 
The  following  data  provide  context  for  this  indicator: 

• average  number  of  full-time  academic  staff 

• number  of  papers  cited 

• percentage  of  papers  cited 


Data  will  be  obtained  to  report  for  five  overlapping  five  year  periods  for  the  University  of 
Alberta,  the  University  of  Calgary  and  the  University  of  Lethbridge,  and  for  “peer  group” 
comparisons  with  similar  Canadian  institutions: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 

McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
i University  of  Montreal 

University  of  Ottawa 

Queen’s  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 

Brandon  University 

Brock  University 

Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary’s  University 

Trent  University 

Wilfred  Laurier  University 
University  of  Winnipeg 

Citation  impact  data  is  not  available  for  Athabasca  University  or  Private  University  Colleges. 
Measures  of  the  extent  of  authorship  and  editorship  of  books;  the  extent  of  publication  through 
refereed  and/or  peer-reviewed  journals,  non-refereed  publications  or  equivalent  means;  and  the 
numbers  of  conference  presentations  will  be  used  to  indicate  the  annual  output  of  research  and 
other  scholarly  activity  that  is  funded,  facilitated  and/or  otherwise  supported  by  these  institutions. 
Peer-reviewed  publications  by  undergraduate  authors  is  included  as  an  indicator  of  the 
involvement  of  students  in  research  and  scholarly  activity  at  these  institutions. 
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Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Citation  impact  indicator 

- 

X 

- 

Number  of  full-time  academic  staff 

- 

X 

- 

Number  of  papers  cited 

- 

X 

. - 

Percentage  of  papers  cited 

- 

X 

- 

Books  authored  or  co-authored 

- 

Athabasca 

X 

Books  edited  or  co-edited 

- 

Athabasca 

X 

Articles  in  refereed  journals 

- 

Athabasca 

X 

Non-refereed  publications 

- 

Athabasca 

X 

Conference  presentations 

Peer-reviewed  publications  by  undergraduate 

- 

Athabasca 

X 

authors 

- 

Athabasca 

X 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  University  of  Alberta,  University  of  Calgary  and  University  of 
Lethbridge.  Athabasca  University  and  the  Private  University  Colleges 
report  in  a special  format. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Average  number  of  full-time  academic  staff 

_ 

KPIRS 

_ 

Number  of  publications  reported 

- 

KPIRS 

- 

Number  of  citations  received 

- 

KPIRS 

- 

Citation  impact 

- 

KPIRS 

- 

Number  of  papers  cited 

- 

KPIRS 

- 

Percentage  of  papers  cited 

- 

KPIRS 

- 

Books  authored  or  co-authored 

- 

KPIRS 

KPIRS 

Books  edited  or  co-edited 

- 

KPIRS 

KPIRS 

Articles  in  refereed  journals 

- 

KPIRS 

KPIRS 

Non-refereed  publications 

- 

KPIRS 

KPIRS 

Conference  presentations 

Peer-reviewed  publications  by  undergraduate 

- 

KPIRS 

KPIRS 

authors 

KPIRS 

KPIRS 

Specifications  & Protocols: 

The  Institute  for  Scientific  Information  (ISI)  produces  a database  of  summary  publication  and  citation 
statistics  that  reflect  research  performance  in  the  sciences  and  social  sciences  for  Canadian  universities. 
The  database  consists  of  counts  of  publications  and  citations  appearing  in  the  6,000  journals  (4,500  in  the 
sciences  and  1,500  in  the  social  sciences)  indexed  by  ISI  over  the  period.  All  these  journals  are  peer- 
reviewed.  For  purposes  of  the  database  ISI  defines  publications  as  including  articles,  notes,  reviews,  and 
proceedings  papers,  but  not  other  types  of  items  such  as  editorials,  letters,  corrections  and  abstracts  or 
books.  Papers  are  attributed  to  an  institution  if  at  least  one  author's  address  identified  the  institution. 
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Three  Alberta  universities  and  their  “peer  group”  institutions  are  among  the  45  Canadian  universities 
included  in  the  database  for  the  years  1981-94,  the  most  recent  release.  The  database  is  in  Microsoft 
Access  v.1.1  format,  accessible  through  a graphical  user  interface  specific  to  predetermined  analyses,  or 
through  MS  Access  (or  a compatible  DBMS)  for  more  detailed  analysis. 

The  University  of  Calgary  currently  subscribes  to  the  ISI  database  and  since  it  has  the  same  “peer  group” 
as  the  University  of  Alberta,  its  reporting  will  be  sufficient  for  both  institutions.  The  University  of 
Lethbridge  should  make  arrangements  to  obtain  data  from  the  University  of  Calgary. 

ISI  has  announced  that  it  will  be  collecting  data  on  the  Humanities,  beginning  in  1996.  This  will  enable 
the  gradual  integration  of  Humanities  data  Into  future  statistics. 

Indicator  information  is  maintained  for  a ten  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  averages  for  five  overlapping  five  year  periods.  Data  from  the  most  recent  ISI  database 
(which  may  include  updates  to  prior  year  data)  are  reported  annually. 

Full-time  academic  staff  - The  average  number  of  full-time  teaching  staff  as  reported  to  Statistics 
Canada  through  the  University  Full-time  Teaching  Staff  System  for  each  five  year  period.  This 
includes  teaching  staff  employed  as  of  October  1 of  the  reporting  year  and  research  staff  who  have  an 
academic  rank  and  a salary  scale  similar  to  teaching  staff,  appointed  on  a full-time  basis  whose  term 
of  appointment  is  not  less  than  twelve  months  (including  staff  members  on  leave). 

Number  of  citations  received  - Total  number  of  citations  received  during  the  time  period. 

Number  of  publications  reported  - Total  number  of  papers  (articles,  notes,  reviews,  and  proceedings 
papers)  reported  through  the  ISI  database  for  a university  during  a given  time  period. 

Citation  impact  - Total  number  of  citations  received  during  a given  time  period  per  publication 
reported  during  the  period. 

Number  of  papers  cited  - Total  number  of  papers  cited  during  the  time  period. 

Percentage  of  papers  cited  - Total  number  of  papers  cited  during  a time  period  expressed  as  a 
percentage  of  the  total  number  of  publications  reported  during  the  period. 

Athabasca  University  and  the  Private  University  Colleges  ~ are  not  included  in  the  ISI  database.  These 
institutions  will  report  publications  indicator  data  obtaining  the  necessary  data  from  a number  of  sources 
including  annual  academic  staff  reports,  faculty  surveys,  and  other  internal  records  and  external  sources. 

These  indicators  combine  highly  disparate  forms  of  research  activity  and  output  into  aggregate  measures 
that  do  not  reflect  the  relative  magnitude  of  activities  or  impacts  of  outputs.  Comparisons  between  and 
among  institutions  may  not  be  valid. 

Indicator  information  is  maintained  for  a five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  and  updates  to 
prior  year  data  are  reported  annually. 

Number  of  Full-time  Academic  Staff  - The  number  of  frill-time  teaching  staff  as  reported  to  Statistics 
Canada  through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff 
employed  as  of  October  1 of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a 
salary  scale  similar  to  teaching  staff,  appointed  on  a full-time  basis  whose  term  of  appointment  is  not 
less  than  twelve  months  (including  staff  members  on  leave). 

Books  Authored  / Co-authored  - The  total  number  of  scholarly  works  reported  by  faculty  members  in 
the  form  of  books  (including  textbooks),  chapters  in  books,  and  monographs,  authored  or  co-authored 
by  the  faculty  members.  Where  more  than  one  co-author  are  faculty  members  at  the  same  institution, 
the  work  is  counted  for  each  faculty  member. 
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Books  Edited  / Co-edited  - The  total  number  of  scholarly  works  reported  by  faculty  members  in  the 
form  of  books  (including  textbooks),  chapters  in  books,  and  monographs,  edited  or  co-edited  by  the 
faculty  members.  Where  more  than  one  co-editor  are  faculty  members  at  the  same  institution,  the 
work  is  counted  for  each  faculty  member. 

Articles  in  Refereed  Journals  - The  total  number  of  articles  and  papers  in  refereed  journals  or 
conference  proceedings. 

Articles  in  Non-refereed  Publications  - The  total  number  of  articles,  papers,  abstracts,  reviews, 
translations,  creative  writings,  research  reports,  manuals,  notes,  bibliographies,  concordances, 
newsletters,  scripts/musical  scores,  recordings,  patents/trademarks/industrial  designs,  posters  and 
other  works,  in  non-refereed  publications.  Includes  works  of  art,  professional  musical  performances, 
artistic  productions  and  compositions  performed  for  external  (public)  audiences. 

Peer-Reviewed  Publications  by  Undergraduate  Authors  - Scholarly  works  in  the  form  of  books  or 
articles  (as  defined  above)  created  by  undergraduate  authors  or  co-authors,  published  through  the 
same  processes  and  media  as  peer-reviewed  scholarly  works  created  by  faculty.  Where  co-authors  are 
students  or  faculty  at  the  same  institution,  the  work  is  counted  for  each  co-author. 
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RESEARCH  - Council  Success  Rates 


National  granting  councils  use  relatively  similar  criteria  applied  consistently  over  time  to 
adjudicate  national  peer-reviewed  grant  competitions.  In  these  competitions,  a variety  of  factors 
are  taken  into  account  including  the  quality  and  innovativeness  of  the  proposed  research  and  the 
reputation(s),  professional  contributions,  published  results,  and  past  performance  of  the 
researcher(s).  On  the  assumption  that  faculty  members  undertaking  quality  research  will  fare 
well  in  these  competitions,  two  indicators  have  been  defined  at  the  institutional  level: 

• the  number  of  grant  awards  in  relation  to  the  number  of  applications  made 
to  these  councils 

• the  average  dollar  value  of  award  received 


Data  will  be  obtained  for  each  Alberta  University,  and  where  available  for  “peer  group” 
comparisons: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 

McGill  University 
University  of  Manitoba 
McMaster  University 
! Memorial  University 

University  of  Montreal 
University  of  Ottawa 

Queen’s  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 

Brandon  University 

Brock  University 

Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary’s  University 

Trent  University 

Wilfred  Laurier  University 
University  of  Winnipeg 

Indicator(s)  Apply  to: 

Colleges  & Technical 

: Universities  .. 

Private  University 

Institutes 

Colleges 

Number  of  awards  / number  of  applications  - X 

Average  dollar  value  of  award  - X 


Level  of  Reporting : By  institution  at  the  total  university 

level. 


Scope:  All  universities.  Peer  group  comparisons  will  not  be 

made  for  Athabasca  University. 
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Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Full-time  academic  staff 

. 

KPIRS 

. 

Number  of  applications 

- 

KPIRS 

- 

Number  of  awards 

- 

KPIRS 

- 

Number  of  awards  / number  of  applications 

- 

KPIRS 

- 

Dollar  value  of  awards 

- ■ 

KPIRS 

- 

Average  value  of  award 

- 

KPIRS 

- 

Specifications  & Protocols: 

Information  on  grants  awarded  (number  of  applications,  number  of  awards,  dollar  value)  is  available 
from  the  Councils,  both  shortly  after  each  competition  and  in  later  consolidated  versions.  Information  on 
academic  staff  members  is  reported  to  Statistics  Canada  through  the  University  Full-time  Teaching  Staff 
System. 

Because  the  pay-out  and  reporting  practices  of  the  three  councils  vary,  between  councils  and  within  each 
council  over  time,  careful  attention  must  be  given  to  appropriate  calculations  for  establishing  the  average 
annual  dollar  value  of  awards  from  the  three  councils. 

The  indicators  are  calculated  as  a rolling  average  using  a base  of  three  years  by  dividing  the  total  number 
of  grants  awarded  by  each  council  over  the  three  most  recent  years  of  available  data  by  the  average 
number  of  eligible  academic  staff  members  during  the  same  time  period.  The  reason  for  the  three-year 
base  is  that  the  Councils  make  multi-year  awards,  usually  for  three  years.  As  a result,  only  a portion  of 
the  eligible  community  is  assessed  in  any  given  year.  In  the  case  of  the  SSHRC  there  is  the  additional 
consideration  of  a low  grant  to  eligible  application  ratio  which  tends  to  produce  significant  variations  in 
the  figures  for  individual  universities  from  year  to  year.  The  three  year  base  will  “smooth”  these  short- 
term perturbations. 

The  most  current  indicator  should  be  accompanied  by  two  historical  reference  points,  which  would 
provide  information  spanning  five  years.  Nationally  comparative  data  on  grants  should  be  available 
within  a year  of  the  end  of  the  fiscal  year,  but  since  Statistics  Canada  must  be  relied  upon  for  nationally 
comparable  academic  staff  numbers,  there  will  be  a two-year  delay. 

This  indicator  is  more  sensitive  to  work  in  the  disciplines  of  engineering,  the  humanities,  medicine,  the 
sciences,  and  the  social  sciences  than  to  the  scholarly  work  carried  out  in  the  fine  arts  or  some  of  the 
professional  faculties.  Nevertheless,  using  appropriate  comparisons,  the  results  are  a reasonable  proxy 
for  the  whole  of  the  institution.  The  size  of  the  eligible  community  and  resources  available  to  serve  the 
community  varies  significantly  from  council  to  council.  When  making  comparisons,  it  is  important, 
therefore,  to  limit  scope  to  institutions  with  appropriate  patterns  of  faculties  and  schools  so  that  similar 
ranges  of  disciplines  are  represented  in  the  calculations. 

Athabasca  University  and  the  University  of  Lethbridge  will  report  disaggregate  information  for  each 
granting  council.  Other  universities  may  report  information  for  each  council  as  an  option.  Peer  group 
comparisons  will  not  be  made  for  Athabasca  University. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
will  report  the  peer  group  data  on  behalf  of  both. 
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Indicator  information  is  maintained  for  a five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 

Granting  Council  - One  of  the  three  national  granting  councils:  Medical  Research  Council  (MRC), 
the  Natural  Science  and  Engineering  Research  Council  (NSERC),  the  Social  Sciences  and  Humanities 
Research  Council  (SSHRC). 

Full-time  academic  staff  - The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1 of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a salary  scale 
similar  to  teaching  staff,  appointed  on  a full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave). 

Number  of  Applications  - For  the  UofA  and  UofC,  the  aggregate  number  of  applications  to  the  three 
national  granting  councils  in  the  general  category  of  “operating”  or  “research”  grants,  for  research 
programs  carried  out  primarily  by  individuals  or  (much  less  frequently)  by  small  teams  of  faculty 
members.  For  the  UofL  and  AU,  the  number  of  applications  to  each  council.  Specifically,  these 
include  Standard  Research  Grants  for  SSHRC;  Individual,  Team  and  Project  Research  Grants  for 
NSERC  as  well  as  the  Research  Grant  portions  only  of  Women’s  Faculty  Awards  and  University 
Research  Fellowships;  and  Operating  and  Program  Grants  for  MRC.  They  exclude  applications  for 
Networks  of  Centres  of  Excellence  (NCE)  grants,  SSHRC  Major  Collaborative  Research  Initiatives, 
MRC  Groups,  or  any  equipment  grants,  infrastructure  support,  stipend  awards,  scholarships  or 
fellowships,  targeted  or  joint-funded  research  projects,  or  other  special  purpose  awards. 

Number  of  Awards  - The  aggregate  number  of  awards  in  the  same  categories  identified  in  the 
specifications  for  Number  of  Applications. 

Dollar  Value  of  Awards  - The  aggregate  annual  dollar  value  of  new  grants  awarded  by  the  three 
national  councils  in  the  same  categories  identified  in  the  specifications  for  Number  of  Applications. 

Number  of  Awards  /Number  of  Applications  - The  aggregate  number  of  awards  divided  by  the 
aggregate  number  of  applications  and  expressed  as  a percentage,  in  the  same  categories  identified  in 
the  specifications  for  Number  of  Applications. 

Average  Value  of  Award  - The  total  dollar  value  of  awards  divided  by  the  aggregate  number  of 
awards,  in  the  same  categories  identified  in  the  specifications  for  Number  of  Applications. 
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RESEARCH  - Graduate  Students 


Graduate  students  enrolled  in  thesis  programs  participate  in  and  contribute  to  the  research 
mandate  of  the  university  and  quality  faculty  members  engaged  in  research  and  scholarship 
attract  students  desiring  research  degrees.  Accordingly,  the  higher  the  proportion  of  thesis  based 
program  graduate  student  enrollees  to  academic  staff,  the  more  research  intensive  and  higher  the 
quality  of  the  academic  staff  and  research  of  the  university.  Unlike  undergraduate  students  who 
are  relatively  less  mobile,  graduate  students  are  more  often  in  a position  to  move  among 
institutions  and,  having  completed  a first  degree,  are  more  sensitive  to  the  quality  of  and  will 
seek  places  at  those  institutions  which  have  the  better  post-graduate  offerings. 

At  the  same  time,  prospective  graduate  students  are  attracted  to  institutions  with  higher  levels  of 
financial  support.  There  tend  to  more  scholarships  and  other  financial  support  opportunities  at 
institutions  with  intensive  research  programs  and  where  a high  priority  is  attached  to  providing 
support  from  internal  sources.  Quality  academic  staff  attract  additional  external  research  funds 
which  provide  paid  research  positions  for  graduate  students  and,  where  needed,  the  resources, 
equipment,  and  other  essentials  needed  for  these  students  to  complete  their  own  research. 

The  following  indicators  deal  with  research  as  it  is  interrelated  with  graduate  instruction  and 
training,  and  the  research  activities  of  graduate  students: 

• graduate  student  enrolment  in  thesis  (i.e.,  research)  based  programs 
relative  to  the  number  of  full-time  academic  staff. 

• total  graduate  enrolment  per  full-time  academic  staff. 

• the  number  of  competitive  national  graduate  scholarships  and  fellowships 
relative  to  the  number  of  full-time  academic  staff. 

For  each  of  these  indicators  and  each  university,  data  will  be  obtained  for  a number  of  similar 
Canadian  institutions  for  “peer  group”  comparisons: 


Alberta  and  Calgary 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 
McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 
Queen’s  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 
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Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Graduate  students  (thesis)  / full-time 
academic  staff 

X 

Total  graduate  students  / full-time  academic 
staff 

_ 

X 

Number  of  graduate  scholarships  and 
fellowships  / full-time  academic  staff 

X 

- 

Level  of  Reporting:  By  institution  at  the  total  university  level. 
Scope:  The  University  of  Alberta  and  The  University  of  Calgary. 


Data  Elements  & Reporting  Systems: 


Full-time  academic  staff 
Total  graduate  students 
Total  graduate  students  / full-time  academic 
staff 

FLE  graduate  students  (thesis  programs) 
FLE  graduate  students  (thesis  programs)  / 
full-time  academic  staff 
Number  of  granting  council  graduate 
scholarships  and  fellowships 
Number  of  graduate  scholarships  and 
fellowships  / full-time  academic  staff 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
' (Colleges 

Data  reported  through  (or  calculated  by) 

_ 

KPIRS 

_ 

- 

KPIRS 

- 

_ 

KPIRS 

- 

KPIRS 

- 

- 

KPIRS 

- 

- 

KPIRS 

- 

_ 

KPIRS 

. 

Specifications  & Protocols: 

The  Canadian  Association  of  Graduate  Schools  (CAGS)  publishes  an  Annual  Statistical  Report  with 
enrolment  data.  Information  about  academic  staff  can  be  obtained  from  Statistics  Canada’s  Teachers  in 
Universities.  The  CAGS  report  appears  annually,  usually  in  the  fall  following  the  end  of  the  traditional 
academic  year.  The  Statistics  Canada  report  usually  appears  a year  later.  The  CAGS  report  is  based  on 
data  supplied  by  the  graduate  schools  using  agreed  definitions. 

Full-time  equivalent  enrolment  is  used  for  indicators  applying  only  to  the  two  Alberta  Universities.  Total 
headcount  (full-time  plus  part-time,  not  weighted)  is  used  for  national  peer  group  comparisons  since  FLE 
data  is  not  available  inter-provincially  on  a comparative  basis. 

Assuming  performance  indicators  are  to  be  reported  in  the  fall  of  each  year,  the  most  recent  institutional 
data  should  be  used  and  converted  to  nationally  comparable  data  as  soon  as  the  latter  become  available. 
The  most  current  indicator  should  be  accompanied  by  four  historical  reference  points,  the  four 
immediately  preceding  years.  As  nationally  comparative  data  may  not  be  available  for  one  or  two  years 
after  internal  data  are  available,  the  full  report  may  include  one  or  two  years  of  unconverted  data  and 
three  or  four  years  of  converted  data.  As  all  Alberta  universities  offering  graduate  programs  subscribe  to 
the  CAGS  reporting  definitions,  the  conversion  of  internal  to  nationally  comparable  data  should  not 
result  in  significant  differences  from  year  to  year. 
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The  indicators  are  not  directly  indicative  of  the  quality  of  academic  staff  or  research  in  areas  where 
course-based  programs  are  offered.  However,  it  is  not  unusual  for  some  faculties,  particularly  in  the 
professional  areas,  to  offer  both  thesis  and  non-thesis  programs.  In  this  regard,  care  must  be  taken  in 
interpreting  Indicator  4;  it  should  be  expected  to  be  lower  in  these  faculties  than  in  facilities  with  no 
course-based  graduate  programs.  Moreover,  in  the  humanities  and  social  sciences  (the  SSHRC 
disciplines)  the  breadth  of  Ph.D.  offerings  in  these  disciplines  will  have  an  effect.  SSHRC  awards  are  for 
doctoral  study  and  institutions  with  limited  Ph.D.  offerings  in  these  disciplines  will  not  fare  as  well. 

Thus,  at  the  institutional  level,  it  is  important  to  limit  comparisons  to  institutions  with  similar  patterns  of 
faculties  and  schools.  For  example,  it  would  be  inappropriate  to  compare  universities  with  a narrow 
range  of  graduate  programs  with  those  which  have  a nearly  full  complement  of  programs  in  virtually  all 
disciplines.  There  should  also  be  comparability  in  the  levels  at  which  degrees  are  offered,  as  between 
master’s  and  doctor’s  programs. 

Because  of  their  limited  graduate  enrolments,  these  indicators  are  not  being  reported  by  Athabasca 
University  and  the  University  of  Lethbridge. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
should  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  Is  maintained  for  a five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada,  and  updates  to  prior  year  data,  are  reported  annually. 

Full-time  Academic  Staff  - The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1 of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a salary  scale 
similar  to  teaching  staff,  appointed  on  a full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave).  Reported  for  Alberta  universities  and  national 
peer  group  institutions. 

FLE  Graduate  Students  (Thesis  Programs ) - Full-load  equivalent  enrolments  including  students  in  a 
qualifying  year  or  as  candidates  for  a Masters  or  Ph.D.  degree  In  a program  for  which  the  completion 
of  a thesis  is  a requirement  for  the  degree.  Reported  for  Alberta  universities  only. 

FLE  Graduate  Students  (Thesis  Programs ) per  Full-time  Academic  Staff  - Full-load  equivalent 
graduate  student  enrolment  in  thesis  programs  divided  by  full-time  academic  staff.  Reported  for 
Alberta  universities  only. 

Total  Graduate  Students  - Total  graduate  enrolment  In  thesis  and  course-based  Masters  and  Ph.D. 
programs,  calculated  as  full-time  students  plus  part-time  students,  not  weighted.  Reported  for  Alberta 
universities  and  national  peer  group  institutions. 

Total  Graduate  Students  per  Full-time  Staff  - Total  graduate  students  enrolment  in  thesis  and  course- 
based  Masters  and  Ph.D.  programs  (full-time  plus  part-time,  not  weighted)  divided  by  the  number  of 
full-time  academic  staff.  Reported  for  Alberta  institutions  and  national  peer  group  institutions. 

Granting  Council  Graduate  Scholarships  & Fellowships  - The  number  of  scholarships  and 
fellowships  awarded  to  graduate  students  through  the  national  council  (MRC,  NSERC  and  SSHRC) 
annual  competitions.  Reported  for  Alberta  universities  and  national  peer  group  institutions. 

# of  Awards /Full-time  Academic  Staff  - The  number  of  scholarships  and  fellowships  awarded 
divided  by  the  number  of  full-time  academic  staff  members  in  the  corresponding  year.  Reported  for 
Alberta  universities  and  national  peer  group  institutions. 
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RESEARCH  - Research  Impact 


These  indicators  measure  returns  from  investments  in  research  facilities,  activities  and 
infrastructure  at  Alberta  universities.  Research  funds  from  all  sources  have  an  important 
economic  impact  on  the  local  or  regional  economy,  in  terms  of  employment  and  job  creation  as 
well  as  through  other  types  expenditures  in  the  local  economy.  Five  indicators  are  included: 

• a “council  support”  ratio  which  relates  revenues  from  the  three  national 
granting  councils  to  total  sponsored  research  revenues. 

• “community  and  industry  support”  ratios  which  relate  revenues  for 
research  of  an  applied  nature  supported  by  grants,  contracts  and  contributions 
from  non-government  sources,  to  total  sponsored  research  revenues,  and  to 
full-time  academic  staff. 

• an  ‘Industry  sponsored  research”  ratio  which  relates  industry  sponsored 
research  support  to  community  and  industry  support. 

• total  annual  licensing  revenues  to  indicate  both  the  value  of  useful  products 
that  originate  in  university  research  and  the  effort  of  researchers  and 
university-industry  liaison  structures  to  move  these  products  into  industry  and 
society. 

• disclosures  of  inventions  and  other  commercially  valuable  intellectual 
property. 


For  these  indicators  and  for  each  university,  data  will  be  obtained  for  a number  of  similar 
Canadian  institutions  for  “peer  group”  comparisons: 


Alberta  and  Calgary 

Lethbridge 

University  of  British  Columbia 
Dalhousie  University 
University  of  Laval 

McGill  University 
University  of  Manitoba 
McMaster  University 
Memorial  University 
University  of  Montreal 
University  of  Ottawa 

Queen’s  University 
University  of  Saskatchewan 
University  of  Sherbrooke 
University  of  Toronto 
University  of  Western  Ontario 

Acadia  University 

Brandon  University 

Brock  University 

Mount  Allison  University 
Mount  St.Vincent  University 
University  of  Prince  Edward  Island 
Saint  Mary’s  University 

Trent  University 

Wilfred  Laurier  University 
University  of  Winnipeg 
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Indicator(s)  Apply  to: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Council  support  ratio  (council  sources  / total 

sponsored  research  revenues) 

- 

UofA,  UofC 

- 

Community  & industry  sources  / full-time 

academic  staff 

- 

UofA,  UofC,  UofL 

- 

Community  & industry  sources  / total 

sponsored  research  revenues 

- 

UofA,  UofC, UofL 

- 

Industry  sources  / community  & industry 

sources 

- 

UofA,  UofC 

- 

Total  licensing  revenues 

- 

UofA,  UofC 

- 

Invention  disclosures 

- 

UofA,  UofC 

Level  of  Reporting:  By  institution  at  the  total  university  level. 

Scope:  The  University  of  Alberta  and  The  University  of  Calgary  for  all 

indicators.  The  University  of  Lethbridge  for  “community  & industry 
support”  ratios. 


Data  Elements  & Reporting  Systems: 

Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Total  sponsored  research  revenues 

- 

KPIRS 

. 

Support  from  council  sources 

Council  support  ratio  (council  sources  / total 

~ 

KPIRS 

- 

sponsored  research  revenues) 

- 

KPIRS 

- 

Support  from  community  & industry  sources 
Community  & industry  sources  / total 

' 

KPIRS 

' 

sponsored  research  revenues 

- 

KPIRS 

- 

Full-time  academic  staff 

Community  & industry  sources  / full-time 

- 

KPIRS 

" 

academic  staff 

- 

KPIRS 

- 

Support  from  industry  sources 

Industry  sources  / community  & industry 

- 

KPIRS 

“ 

sources 

- 

KPIRS 

Total  licensing  revenues 

- 

KPIRS 

- 

Invention  disclosures 

mimtmmmmmmmismsi 

KPIRS 

Specifications  & Definitions: 

Research  revenues,  are  reported  by  each  university  (Alberta  universities  and  peer  group  institutions) 
through  Statistics  Canada  and  the  Canadian  Association  of  University  Business  Officers  (CAUBO)  using 
definitions  and  formats  developed  by  the  latter,  and  should  be  available  for  Alberta  and  other  Canadian 
universities,  through  CAUBO,  for  peer  group  comparisons.  For  the  most  recent  year(s),  CAUBO  reports 
(and,  therefore,  peer  comparison  data)  may  not  be  available,  preliminary  Alberta  universities  data  can  be 
obtained  from  the  financial  records  of  each  university. 


KPI  Reporting  Manual 


Page  100 


December  1998 


These  indicators  are  not  being  reported  by  Athabasca  University. 

Since  the  University  of  Alberta  and  the  University  of  Calgary  use  the  same  peer  group,  one  institution 
will  be  identified  to  report  the  peer  group  data  on  behalf  of  both. 

Indicator  information  is  maintained  for  a five  year  period  ending  with  the  reporting  year,  to  enable  the 
calculation  of  three  three-year  rolling  averages.  Data  for  the  most  recent  year  available  from  Statistics 
Canada  and  updates  to  prior  year  data  are  reported  annually. 


Total  Sponsored  Research  Revenues  - All  sponsored  research  revenues  from  federal,  provincial,  non- 
profit and  not-for-profit  agencies  including  grants,  contracts  and  other  types  of  awards.  Normally 
these  revenues  are  separate  and  segregated  from  revenues  which  support  the  general  operations  of  the 
university. 

Support  from  Council  Sources  - The  aggregate  of  grants  received  from  national  granting  councils:  the 
Medical  Research  Council  (MRC),  the  Natural  Science  and  Engineering  Research  Council  (NSERC), 
and  the  Social  Sciences  and  Humanities  Research  Council  (SSHRC).  This  corresponds  to 
“Government  grants  - Federal”  for  the  three  specified  councils,  in  the  CAUBO  format. 

Council  Support  Ratio  ( Councils  Sources  / Total  Sponsored  Research  Revenues)  - Total  grants  and 
awards  from  the  three  national  granting  councils  expressed  as  a percentage  of  total  sponsored  research 
revenues. 

Support  from  Community  & Industry  Sources  - Bequests,  donations  and  non-government  grants  for 
sponsored  research,  from  individuals,  corporate  commercial  enterprises,  foundations  and  non-profit 
organizations.  This  corresponds  to  “Bequests,  donations,  non-government  grants”  with  the  sub- 
classifications “Individuals,  Corporate  business  enterprises.  Foundations  and  Non-profit 
organizations”  in  the  CAUBO  format. 

Community  & Industry  Sources  /Total  Sponsored  Research  Revenues  - Total  bequests,  donations  and 
non-government  grants  for  research  purposes  expressed  as  a percentage  of  the  total  sponsored 
research  revenues. 

Full-time  Academic  Staff  - The  number  of  full-time  teaching  staff  as  reported  to  Statistics  Canada 
through  the  University  Full-time  Teaching  Staff  System.  This  includes  teaching  staff  employed  as  of 
October  1 of  the  reporting  year  and  research  staff  who  have  an  academic  rank  and  a salary  scale 
similar  to  teaching  staff,  appointed  on  a full-time  basis  whose  term  of  appointment  is  not  less  than 
twelve  months  (including  staff  members  on  leave).  Reported  for  Alberta  universities  and  national 
peer  group  institutions. 

Support  from  Community  & Industry  Sources  /Full-time  Academic  Staff  - Support  from  Community  & 
Industry  Sources  divided  by  the  number  of  full-time  academic  staff. 

Support  from  Industry  Sources  - Sponsored  research  revenues  including  grants,  contracts,  awards  and 
other  funding  support  from  corporate  commercial  enterprises  (private  business,  commercial  and 
industrial  organizations  and/or  agencies  acting  on  their  behalf).  This  isolates  the  “corporate  business 
enterprise”  sub-category.  Although  not  published  in  the  CAUBO/Statistics  Canada  reports,  this  data 
will  be  obtained  for  peer  group  comparisons,  if  available,  from  CAUBO. 

Industry  Sources  / Community  & Industry  Sources  - Total  industry  sponsored  research  revenues 

expressed  as  a percentage  of  total  sponsored  research  revenues  from  community  and  industry  sources. 

Total  Licensing  Revenues  - Revenues  accruing  from  the  commercial  and/or  industrial  application  and 
development  of  patents,  industrial  designs,  and  other  intellectual  property.  These  data  are  not 
currently  reported  at  a provincial  or  national  level  but  will  be  obtained  from  reports  published  by  the 
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Association  of  University  Technology  Managers,  Inc.  (AUTM)3.  Peer-group  comparisons  will  be 
limited  to  institutions  reporting  through  the  AUTM  surveys. 

Invention  Disclosures  - Disclosures  of  inventions  and  other  commercially  valuable  intellectual  property. 
Not  currently  reported  at  a provincial  or  national  level  but  will  be  obtained  from  AUTM. 


3 Association  of  University  Technology  Managers,  Inc.,  49  East  Avenue,  Norwalk,  CT  06851. 
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RESEARCH  - Distance  Education 


Athabasca  University  is  developing  a special  indicator  for  research  relating  to  distance 
education.  Documentation  will  be  included  in  a future  version  of  this  manual. 


KPI  Reporting  Manual 


Page  103 


December  1998 


KPI  Reporting  Manual 


Page  104 


December  1998 


COMMUNITY  SERVICE  and  ECONOMIC  IMPACT 


The  impact  of  an  educational  institution  on  its  local  economy  can  be  estimates  using  a model 
which  estimates  the  total  local  income  (“gross  domestic  product”)  produced  by  the  institution’s 
spending  in  the  local  community,  and  the  total  local  employment  generated. 


Indicator(s)  Apply  to: 

Total  local  income  generated 
Total  local  employment  generated 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

X 

X 


Reporting  Level:  By  institution  at  the  total  university  level. 

Scope:  University  of  Alberta,  University  of  Calgary  and  University  of 

Lethbridge.  Since  Athabasca  University  provides  programs  and  services 
to  students  and  communities  across  the  Province,  it  will  not  report  on 
these  indicators. 


Data  Elements  & Reporting  Systems: 


Colleges  & Technical 
Institutes 

Universities 

Private  University 
Colleges 

Data  reported  through  (or  calculated  by) 

Total  local  income  generated 
Total  local  employment  generated 


KPIRS 

KPIRS 


Specifications  & Protocols: 

Each  institution  will  report  two  data  elements: 

1 . Total  Local  Income  Generated  - An  estimate  of  the  total  annual  cash  flow  into  an  institution’s 
local  economy  arising  from  four  sources:  faculty  and  staff  spending,  university  non-salary  local 
spending,  student  spending  and  visitor  spending,  incremented  by  a local  “multiplier  effect” 
which  takes  into  account  the  additional  indirect  income  impact  as  each  dollar  spent  moves  from 
one  supplier/consumer  to  the  next  in  the  economy. 

2.  Total  Local  Employment  Generated  - An  estimate  of  the  total  annual  local  employment 
generated,  expressed  in  FTE  numbers.  The  figure  includes  both  the  direct  employment  created 
within  the  institution  as  well  as  the  indirect  employment  in  the  local  economy  generated  by  the 
“multiplier  effect”. 


The  methodology  needed  to  derive  local  economic  impact  figures  requires  many  assumptions  and 
estimates.  To  avoid  giving  the  results  a false  level  of  precision  the  figures  reported  should  be  rounded 
somewhat.  The  total  local  income  figure  is  rounded  to  the  nearest  $100,000  (e.g.  $ 147.6  million),  and 
the  total  local  employment  figure  is  rounded  to  the  nearest  100  FTE  (e.g.  4,700  FTE). 
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Data  Date  of  Record  and  Timing  of  the  Study 

It  is  anticipated  that  KPI  data  will  be  reported  in  January  of  each  year. 

Economic  impact  data  are  derived  for  the  annual  period  coinciding  with  the  universities’  preceding  fiscal 
year,  ending  March  31  for  all  institutions.  In  order  to  derive  student  and  visitor  spending  estimates,  the 
corresponding  ‘‘academic  year”  is,  for  purposes  of  this  study,  assumed  to  start  with  the  semester 
beginning  in  May  and  finish  with  the  semester  ending  in  April,  in  order  to  coincide  as  closely  as  possible 
with  the  fiscal  year.  For  example,  data  for  the  1995-96  fiscal  year  was  reported  in  December  1996;  the 
data  included  student  and  visitor  spending  estimates  derived  from  the  Spring  1995,  Summer  1995,  Fall 
1995  and  Winter  1996  semesters. 

Audited  financial  data  for  the  preceding  fiscal  year  are  generally  available  (in  the  form  of  pre-publication 
financial  statements)  in  late  Summer  at  all  institutions,  allowing  the  study  to  be  completed  in  time  for  the 
January  reporting  deadline. 

Conceptual  Model  of  Economic  Impact  on  the  Local  Economy 

The  economic  impact  model  used  is  generally  described  as  a short  term,  cash  flow  model.  It 
encompasses  an  analysis  of  an  institution’s  annual  direct  expenditures  on  local  goods  and  services,  and 
the  local  spending  of  its  faculty  and  staff,  its  students  and  its  visitors.  The  employment  impact  of  the 
institution  is  also  part  of  the  study. 

The  total  annual  direct  spending  is  incremented  by  a local  multiplier  which  takes  into  account  the 
additional  indirect  business  volume  generated  as  a result  of  the  direct  spending  of  the  school,  its 
employees,  students  and  visitors.  Direct  employment  is  incremented  by  an  employment  multiplier. 

The  local  community  is  defined  as  each  university’s  immediate  metropolitan  area  and  any  surrounding 
“bedroom  communities”  in  which  the  institution’s  employees  live. 

Institutional  Spending  Defined 

The  study  results  include  the  expenditure  and  employment  data  derived  from  operating  and  capital 
budget  accounts  as  well  as  sponsored  research  and  other  trust  money  accounts. 

A number  of  affiliated,  non-institutional  agencies,  organizations  and  businesses  exist  on  every  campus. 
While  some  of  these  are  research  institutes  funded  under  the  auspices  of  departments  and  faculties  or 
funded  from  sponsored  research  grants,  others  are  separate  non-profit  agencies  funded  from  various  non- 
institutional  sources.  Student  unions  are  examples  of  the  latter  group.  In  principle  the  economic  and 
employment  impacts  of  these  groups  should  be  included  in  the  study  as  they  owe  their  existence  to  the 
presence  of  the  university  and  have  a local  economic  impact.  However,  it  was  decided  that  issues  of  data 
availability,  confidentiality  and  inter-institutional  comparability  likely  preclude  the  inclusion  of  these 
groups’  impacts  in  the  study.  Accordingly,  the  study  is  confined  to  the  institutional  expenditures  (and 
related  employment)  documented  in  the  institution’s  financial  data  bases  and  reported  in  its  annual 
financial  statements. 

As  an  exception  to  the  last  statement,  however,  the  expenditures  of  certain  ancillary  units  are  excluded 
from  the  study.  In  general,  the  units  in  question  are  those  selling  goods  and  services  to  students,  staff  and 
faculty,  such  as  the  Bookstore,  Microcomputer  Store,  Student  Housing,  Food  Services,  Campus 
Recreation,  Parking,  etc.  The  main  rationale  for  excluding  these  units  is  that  including  their  economic 
activity  would  yield  a certain  amount  of  double  counting  of  cash  flow  into  the  local  economy  since 
student,  faculty  and  staff  expenditures  are  captured  elsewhere  in  the  analysis.  Excluding  the  units’ 
expenditures  from  the  study  resolves  the  double  counting  problem.  In  addition,  because  institutions 
expect  these  units  to  fully  recover  their  costs  from  sales,  and  so,  in  a sense,  treat  the  units  as  separate 
business  entities,  there  is  a philosophical  consistency  in  excluding  their  activities  from  the  study  (i.e., 
they  are  treated  like  other  campus  business  enterprises). 
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Faculty  and  Staff  Spending  in  the  Local  Community 

It  is  assumed  that  faculty  and  staff  local  spending  is  identical  to  net  disposable  income.  Net  disposable 
income  is  assumed  to  equal  net  “take  home”  salaries  and  wages.  The  following  general  approach  may  be 
used  to  calculate  this  amount. 

1.  The  amount  of  total  gross  salaries  paid  to  faculty  and  staff  is  determined.  This  amount  is 
generally  available  in  institutional  financial  statements,  and  should  comprise  the  salaries  paid 
from  operating  as  well  as  sponsored  research  and  other  trust  accounts. 

2.  Payroll  records  are  used  to  determine  total  annual  amounts  deducted  for  non-discretionary  items 
such  as  pension  contributions  (including  Canada  Pension  Plan),  unemployment  insurance, 
income  taxes,  etc.  However,  amounts  for  discretionary  items,  such  as  United  Way  contributions 
or  fees  for  parking,  recreation,  and  faculty  clubs,  etc.,  are  not  included  in  this  total.  The  analysis 
should  include  payroll  records  for  salaries  and  wages  paid  from  operating  funds  as  well  as 
records  for  salaries  paid  from  sponsored  research  and  other  funds  held  in  trust. 

3.  From  the  original  gross  salaries  figure,  an  amount  is  subtracted  equivalent  to  the  total  salaries 
paid  to  staff  in  the  ancillary  units  as  well  as  the  total  salaries  paid  to  students.  Institutional 
expenditure  summaries  that  are  more  detailed  than  the  financial  statements  may  be  needed  to 
derive  these  amounts. 

4.  The  non-discretionary  deductions  data  from  step  2 and  the  gross  salaries  figure  resulting  from 
step  3 are  used  to  calculate  the  faculty  and  staff  local  spending  figure.  The  basic  method  for  this 
calculation  is  to  subtract  the  deductions  figure  from  the  gross  salaries  figure,  however,  some 
adjustments  may  be  necessary  to  account  for  the  student  and  ancillary  staff  salaries  and  their 
attendant  deductions. 

The  main  rationale  for  excluding  non-discretionary  deductions  is  that  they  are  primarily  leakages  from 
the  local  economy.  There  is  no  way  of  determining  when  or  if  the  money  is  spent  in  the  local  economy. 
However,  it  should  be  noted  that  three  types  of  non-discretionary  payroll  deductions  were  viewed  by  the 
committee  not  to  be  leakages,  and  hence  should  not  be  subtracted  from  the  total  gross  salaries  figure. 

The  three  types  are  Alberta  Health  Care  premiums,  dental  plan  premiums  and  extended  health  care 
premiums.  It  was  felt  that  money  deducted  for  health  and  dental  premiums  rolls  back  into  the  local 
economy  continuously  in  the  form  of  payments  to  dentists,  dental  labs,  hospitals,  doctors  and  other  health 
care  practitioners. 

Salaries  of  faculty  on  leave  are  not  deducted  or  discounted  in  any  way  because  it  is  not  possible  to 
determine  what  proportion  of  the  salaries,  on  average,  is  spent  outside  of  the  local  region. 

In  determining  faculty  and  staff  local  expenditures  the  economic  impact  study  literature  often  suggests 
that  an  amount  for  estimated  savings  should  be  deducted  from  net  disposable  income  figures.  It  was 
decided  to  ignore  this  issue  because  determination  of  reasonable  savings  rates  is  problematical. 
Furthermore,  it  is  possible  that,  even  in  the  short  term,  savings  are  put  to  work  in  the  local  economy. 

University  Direct  Expenditures  on  Local  Goods  and  Services 

The  method  of  deriving  the  amount  of  university  direct  expenditures  on  local  goods  and  services  can  only 
be  outlined  here,  as  each  university’s  financial  systems  and  volume  of  transactions  are  unique.  First,  the 
non-salary  goods  and  services  expenditures  of  the  university  must  be  derived  from  operating,  capital, 
sponsored  research  and  other  trust  fund  accounts.  Second,  the  amount  or  proportion  spent  locally  must 
be  determined. 

Fringe  benefit  expenditures  made  by  the  institution  are  excluded  from  the  study.  Most  of  these 
expenditures  are  viewed  as  short  term  leakages  from  the  local  economy.  Although  benefits  may  flow 
back  to  the  local  economy  at  some  point  in  time,  the  dollar  value  of  those  returns  cannot  be  determined  in 
the  short  term.  However,  there  are  three  exceptions  to  the  rule  that  fringe  benefits  are  excluded: 
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employer  paid  premiums  for  Alberta  Health  Care,  extended  health  care  and  dental  plans  are  included. 

The  reason  for  this  exception,  as  noted  in  the  previous  section  dealing  with  faculty  and  staff  spending,  is 
that  these  premiums  are  not  viewed  as  short  term  leakages. 

Methods  used  by  the  institutions  to  estimate  local  expenditures  may  range  from  qualitative  approaches, 
involving  the  expert  opinion  of  purchasing,  financial  services  or  materials  management  staff,  to 
quantitative  approaches  (both  manual  and  computer  assisted)  which  query  accounts  payable  data  bases 
and  attempt  to  derive  local  expenditures  using  supplier  postal  codes  or  telephone  numbers  as  local 
criteria.  It  is  recognized  that  supplier  postal  codes  may  be  unreliable  indicators  of  local  suppliers  since 
some  firms  distribute  goods  or  services  from  a non-local  site  yet  have  a local  office  for  invoicing 
purposes;  conversely,  other  firms  may  provide  goods  or  services  from  a local  site  yet  invoice  from  a non- 
local head  office.  Some  institutions  may  use  quantitative  approaches  as  initial  screening  devices  and 
then  temper  the  results  using  the  knowledge  and  judgment  of  the  expert  staff  mentioned  above. 

Student  Expenditures 

For  purposes  of  estimating  student  expenditures,  official  student  counts  are  compiled  for  each  semester, 
including  spring  and  summer  semesters.  By  agreement,  part  time  students  are  included  in  the  derivation 
of  FLE  student  numbers  at  a rate  of  50%;  i.e.,  FLE  student  counts  for  a given  semester  are  calculated  as 
100%  of  the  full  time  student  headcount  plus  50%  of  the  part  time  headcount.  Discounting  part  time 
students  in  this  manner  results  in  a more  conservative  estimate  of  student  spending. 

Student  expenditures  are  based  on  Alberta  Students  Finance  Board  (ASFB)  estimates  of  individual 
monthly  student  budgets  for  the  year  in  question.  Each  year,  the  ASFB  provides  separate  budgets  that 
vary  according  to  whether  students  are: 

1 . single  and  living  with  parents,  or 

2.  single  and  living  away  from  home,  or 

3.  married. 

The  universities  differ  from  one  another  in  the  age  and  marital  status  mix  of  their  students  and  in  the 
relative  mix  of  commuters  and  residential  students.  Thus,  each  institution  must  determine  estimates  of 
the  proportions  of  students  in  each  of  the  three  ASFB  categories.  These  estimates  may  be  derived  from 
several  sources:  student  information  systems,  recent  student  surveys,  or  estimates  by  university 
personnel.  The  ASFB  also  provides  a monthly  budget  estimate  for  single  parent  families.  Because  the 
Alberta  universities  do  not  have  reliable  estimates  of  numbers  of  single  parent  students  this  student 
category  is  ignored. 

The  following  method  of  calculating  estimated  student  expenditures  may  be  used: 

1 . Determine  the  number  of  student-months  in  each  semester  by  multiplying  each  semester’ s FLE 
student  count  by  the  number  of  months  in  the  semester. 

2.  Sum  the  numbers  of  semester  student-months  to  arrive  at  an  annual  number  of  student-months. 

3.  Determine  the  pro  rata  numbers  of  student-months  in  each  of  the  three  ASFB  categories  by 
multiplying  the  annual  number  of  student-months  by  the  estimated  institutional  proportions. 

4.  Multiply  the  pro  rata  numbers  for  each  category  by  the  corresponding  ASFB  monthly  student 
budgets  to  yield  total  annual  student  expenditures  in  each  of  the  three  categories. 

5.  Sum  the  resulting  student  expenditures  to  yield  total  annual  student  expenditures. 

Visitor  Expenditures 

It  is  difficult  to  collect  data  concerning  the  number  of  local  area  visitors  who  visit  for  a university  related 
purpose  and  data  concerning  the  duration  of  their  stay.  The  collection  of  data  that  are  complete, 
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accurate,  consistent  from  year  to  year  and  comparable  among  institutions  is  problematic.  The  results  of 
most  university  economic  impact  studies  indicate  that  visitor  spending  is  a relatively  small  proportion  of 
total  spending  in  the  local  economy.  Extraordinary  efforts  to  collect  such  data  likely  yield  diminishing 
returns. 

Each  institution  will  collect  data  considered  by  the  institution  to  be  reliable  and  accurate.  These  data 
may  include,  for  example,  numbers  of  out-of-town  conference  delegates  who  attended  university 
sponsored  conferences  and  the  duration  of  those  conferences.  These  data  perhaps  can  be  provided  by  a 
campus  conference  office.  As  a further  example,  the  athletics  department  may  be  able  to  provide  annual 
numbers  of  visitors  who  are  members  of  varsity  athletic  teams. 

Visitor  expenditures  are  calculated  by  multiplying  numbers  of  visitor-days  by  estimated  per  diem 
expenditures.  Each  university  will  develop  its  own  set  of  per  diem  expenditures,  taking  into  account 
local  factors  and  prices.  As  a starting  point,  estimated  per  diem  expenditures  for  conference  attendees 
are  usually  available  from  the  local  convention  and  visitors  bureau.  However,  convention  bureau 
estimates  may  need  to  be  tempered  and  adjusted  to  reflect  the  spending  patterns  of  various  types  of 
university  visitors.  If  the  university  has  per  diem  food  and  lodging  allowances  for  its  own  faculty,  staff 
and  varsity  athletic  team  members  these  might  be  used  to  temper  the  convention  bureau  estimates. 

Direct  Employment 

Employment  data  will  include  faculty  and  staff  funded  from  operating  funds  as  well  as  sponsored 
research,  endowment  and  other  trust  funds.  Official  institutional  full-time  equivalent  counts  should  be 
used.  These  counts  are  generally  taken  at  a point  in  time  (e.g.  December  31),  and  may,  as  a result, 
exclude  certain  seasonal  staff.  Numbers  of  faculty  on  leave  are  included.  Numbers  of  students  employed 
by  the  institution  are  included.  Numbers  of  staff  employed  in  the  ancillary  units  are  included. 

Income  and  Employment  Multipliers 

Alberta  universities  have  agreed  to  use  the  following  multipliers  for  economic  impact  studies: 


Income  Multipliers: 

Athabasca  University  1 . 2 

University  of  Alberta  1 .7 

University  of  Calgary  1 .7 

University  of  Lethbridge  1 .5 

Employment  Multipliers: 

All  universities  1.5 


These  multiplier  values  are  based  on  a survey  of  the  literature  concerning  university  and  other  industry 
economic  impact  studies.  The  survey  indicated  the  above  values  are  conservative  multipliers  for 
municipalities  of  a similar  size.  Alberta  economic  data  are  not  available  to  support  a numerical 
computation  of  the  multipliers. 

The  total  direct  annual  cash  flow  into  the  local  economy  is  derived  by  summing  the  cash  flow  arising 
from  the  four  sources:  faculty  and  staff  spending,  university  non-salary  local  spending,  student  spending 
and  visitor  spending.  Total  local  income  is  then  calculated  by  multiplying  the  total  direct  cash  flow  by 
the  value  of  the  multiplier.  Similarly,  total  local  employment  is  calculated  by  multiplying  direct 
employment  by  the  value  of  the  employment  multiplier. 
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APPENDIX  A 


Guidelines  for  Conducting  KPI  Employment  and  Satisfaction 

Surveys 


Prepared  for 

Alberta  Advanced  Education  and  Career  Development  (AECD) 
by  Harvey  Krahn 

Department  of  Sociology,  University  of  Alberta 
November  4, 1998 


L Timing  of  Surveys 


Employment  and  Satisfaction  Surveys 

• Institutions  have  agreed  to  conduct  surveys  and  report  data  for  both  employment  and  satisfaction 
every  two  years.  Collection/reporting  of  employment  and  satisfaction  data  will  be  staggered  (i.e., 
employment  one  year,  satisfaction  the  next). 

• If  they  choose,  institutions  may  conduct  either  or  both  employment  and  satisfaction  surveys  on  an 
annual  basis,  for  their  own  planning  and  program-evaluation  purposes. 

• If  institutions  do  conduct  annual  surveys,  they  should  not  average  the  results  from  two 
surveys  when  reporting.  While  doing  so  might  make  their  data  more  reliable,  comparability 
with  other  institutions  that  do  not  conduct  annual  surveys  will  be  lost. 

Employment  Survey 

• For  colleges  and  technical  institutions,  the  employment  survey  should  be  conducted  6 to  9 months 
after  program  completion/graduation.  The  6-9  month  period  allows  institutions  to  conduct  a single 
survey  for  individuals  completing  programs  at  different  times  (e.g.,  program  X finishes  in  January, 
while  program  Y finishes  in  March). 

• For  universities,  the  employment  survey  will  be  conducted  two  years  after  graduation  (convocation). 
If  a university  has  more  than  one  convocation  period  per  year,  the  survey  should  be  conducted  2 
years  after  the  convocation  with  the  largest  number  of  graduates.  Individuals  who  graduated  in  the 
earlier  (smaller)  convocation  in  the  same  reporting  year  should  also  be  surveyed  at  this  time. 

• Some  institutions  may  have  students  who  completed  more  than  one  program  during  the  previous 
reporting  period.  Asking  these  individuals  to  complete  two  interviews/questionnaires  would  be 
problematic.  The  institution  should  determine  which  of  the  two  programs  was  the  longer  program, 
and  enquire  about  that  program. 
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Satisfaction  Survey 


• The  satisfaction  survey  should  be  conducted  at  the  end  of  the  academic  year  in  which  individuals 
completed  their  program  and/or  requirements  for  graduation;  “end  of  the  academic  year”  means  the 
last  few  weeks  of  the  program,  usually  just  before  students  write  final  examinations  (if  final  exams 
are  part  of  the  program). 

• Some  institutions  may  have  students  completing  programs  at  different  times  during  the  year.  If  so,  it 
would  be  most  efficient  to  conduct  a single  survey  when  the  largest  number  of  students  are  finishing. 
Other  students  who  finished  earlier  in  the  year  should  also  be  surveyed  at  this  time. 

• Institutions  might  choose  to  survey  completers/graduates  of  different  programs  at  different 
times  during  the  year.  If  so,  results  from  separate  surveys  during  a single  year  should  still  be 
reported  in  a single  package. 

• Some  institutions  may  have  students  who  completed  more  than  one  program  during  the  year.  Asking 
these  individuals  to  complete  two  interviews/questionnaires  would  be  problematic.  The  institution 
should  determine  which  of  the  two  programs  was  the  longer  program,  and  enquire  about  the  student’s 
satisfaction  with  this  program. 

IL  Conducting  the  Surveys 

• Each  institution  can  conduct  its  own  surveys  (in-house  or  using  a contractor),  but  institutions  are 
encouraged  to  work  together  (as  the  universities  already  do  and  the  private  university  colleges  intend 
to  do),  since  this  will  provide  a more  standardized  reporting  product  and  might  reduce  costs. 

• Institutions  can  collect  data  either  by  telephone  or  with  self-administered  questionnaires  (the  latter 
distributed  either  by  mail  or  in  class). 

• Institutions  must  use  a standardized  set  and  sequence  of  questions  (slightly  different  for  telephone 
and  self-administered  surveys)  for  required  KPI  questions,  but  may  add  additional  complementary 
questions  of  their  own  choice  and  design. 


NOTE:  Telephone  and  self-administered  versions  of  both  the  employment  and  satisfaction 
questionnaires  {required  KPT  questions  only)  are  attached.  The  response  categories  for  some  of  the 
questions  have  been  modified,  to  obtain  a standardized  1-5  response  scale  wherever  possible.  Such 
changes  will  affect  comparisons  between  survey  results  reported  for  1997-98  and  earlier,  and  results 
using  the  new  response  scale.  For  example,  for  a question  about  the  fit  between  a program  of  study  and 
an  individual*  s job,  a set  of  four  response  categories  would  reveal  a higher  proportion  of  respondents  in 
the  (very  or  somewhat)  “related”  group  than  would  a set  of  five  response  categories  (some  individuals  in 
the  “related”  group  might  now  choose  the  ‘neutral’  mid-point).  AECD  is  aware  of  the  implications  of 
changes  in  response  categories,  and  will  not  make  unqualified  comparisons  for  questions  that  have  been 
altered. 


If  additional  complementary  questions  are  used,  the  questionnaire  must  begin  with  the  required  KPI 
questions. 

• While  additional  complementary  questions  might  usefully  be  grouped  within  and  around  the 
required  questions,  different  sets  and  sequences  of  complementary  questions  used  by 
different  institutions  could  create  “ordering  effects”  that  might  compromise  standardized 
measurement  of  the  required  questions  (e.g.,  asking  additional  satisfaction  questions  could 
affect  an  individual’s  response  to  subsequent  required  questions). 

Institutions  must  use  a standardized  telephone  introduction  (or  cover  letter  for  self-administered 
questionnaires).  If  institutions  decide  that  some  modification  is  required,  they  must  indicate  to 
AECD,  when  reporting  their  KPI  results,  how  and  why  the  standardized  script  has  been  modified. 
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• If  a self-administered  questionnaire  is  used  in  a classroom  setting,  the  person  administering 
the  survey  can  read  the  cover  letter  to  students,  but  students  should  also  be  provided  with  a 
paper  copy  of  the  letter. 

• Information  must  be  collected  from  the  program  completer/graduate.  Proxy  data  (from  parents  or 
roommates,  for  example)  is  not  acceptable.  Such  individuals  might  know  if  the  person  is  employed  or 
a student,  but  would  be  unreliable  respondents  for  hours  worked,  income,  fit  between  program  and 
job  (employment  survey),  and  satisfaction  with  the  program  and  the  institution  (satisfaction  survey). 


Note:  This  is  a change  from  the  earlier  KPI  methodology,  which  accepted  proxy  data  if  sources  could  be 
verified. 


• The  standardized  introduction  for  the  telephone  surveys  includes  a note  to  interviewers  indicating 
that:  “If  the  individual  does  not  live  in  this  household,  try  to  obtain  a new  telephone  number.  Explain 
purpose  of  study  (see  below)  if  requested.  Thank  the  person  providing  the  information.  ” Requesting 
a new  phone  number  from  someone  other  than  the  respondent  might  be  seen  as  going  beyond  FOIP 
guidelines.  However,  it  is  AECD’s  position  that  this  is  an  acceptable  practice  since  telephone 
numbers  are  in  the  public  domain  and  since  the  individual  being  asked  (e.g.,  a parent  or  former  room- 
mate) can  decide  not  to  provide  the  new  number.  However,  institutions  (or  their  data  collection 
contractors)  should  also  willingly  accept  a “no,  I can’t  give  you  her/his  number”  response. 

• Some  data  collection  firms  record  telephone  interviews  for  verification  purposes.  If  such  a practice  is 
employed  (by  an  educational  institution  or  a contractor),  the  respondent  must  be  informed  that  the 
interview  is  being  recorded  and  why,  and  must  (verbally)  consent  to  the  recording  of  the  interview. 
While  the  recording  is  proceeding,  a periodic  beep  (e.g.,  ten  second  intervals)  must  be  clearly  audible 
to  the  respondent. 

• Institutions  must  retain  the  data  collected  in  a survey  (the  data  base  in  a telephone  administered 
survey;  questionnaires  in  a self-administered  survey)  for  at  least  one  year  (a  FOEP  requirement).  If 
the  data  are  being  collected  by  a private  contractor,  the  institution  must  ensure  that  all  the  contact 
information  (e.g.,  names,  phone  numbers)  initially  provided  to  the  contractor  is  returned  after  the 
data  collection  is  completed. 

III.  Census  or  Sample  Survey 

• Most  institutions  in  the  college  sector  currently  conduct  a census  (all  program  completers/graduates) 
to  collect  KPI  employment  and  satisfaction  data.  The  universities  used  a sample  survey  design  for 
their  first  KPI  satisfaction  survey  and  the  census  approach  for  their  first  KPI  employment  survey. 

• Institutions  in  both  the  college  and  university  sectors  may  use  a sample  survey  approach  (for  either 
the  employment  or  the  satisfaction  surveys),  if  their  completion/graduation  numbers  are  large  enough 
(see  below).  Some  larger  institutions  might  still  prefer  to  use  the  census  approach,  to  acquire 
additional  information  to  fine-tune  their  programs. 

• Random  sampling  (or  an  equivalent  systematic  sample;  see  below)  must  be  used  if  the  sample  survey 
approach  is  chosen. 

Samvlin2  Guidelines 

• Sampling  (rather  than  a census)  may  be  used  if  an  institution  has  more  than  1000 
graduates/program  completers  (across  all  programs)  in  a given  reporting  year. 

• If  such  institutions  choose  to  use  a sample  survey  approach,  a sampling  fraction  of  at  least  “1  in 
2”  should  be  used  (institutions  could  choose  to  survey  a larger  random  sample  if  they  desired). 

A systematic  sample  (choosing  every  2nd  name  from  an  alphabetized  list  of  names)  would  be  an 
acceptable  alternative  to  a random  sample. 

IV-  Data  Collection 
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• Response  rates  of  at  least  50%  are  required  for  both  the  employment  and  the  satisfaction  surveys  (for 
both  telephone  and  self- administered  questionnaires). 

• Institutions  (or  outside  contractors)  using  a telephone  survey  approach  should  make  at  least  five  call- 
backs, preferably  at  different  times  of  the  day  and  week,  to  ensure  that  a 50%  response  rate  is 
obtained. 

• Institutions  using  a mail  survey  approach  should  follow-up  with  reminder  letters  and/or  phone  calls 
to  ensure  that  a 50%  response  rate  is  obtained. 

• Institutions  using  a telephone  survey  can,  if  they  wish,  offer  to  send  a questionnaire  by  mail  to 
individuals  who  refuse  to  participate  in  the  telephone  survey.  This  approach  might  lead  to  slightly 
higher  response  rates.  If  institutions  do  use  such  a mixed-method  approach,  they  should  indicate  this 
to  AECD  when  reporting  their  data,  including  a note  about  the  proportion  of  total  responses  received 
by  mail. 

• Response  rates  should  be  calculated  at  the  institution  level  (not  program  level). 

• If  a census  approach  is  used,  response  rates  must  be  calculated  with  the  total  number  of 
graduates/program  completers  as  the  base  (no.  of  respondents/no.  of  completers/graduates). 

• If  a random  sample  survey  approach  is  used,  the  base  for  the  calculation  should  be  the 
number  of  graduates/completers  included  in  the  initial  sample  (no.  of  respondents/initial 
sample  size). 

• Institutions  must  report  response  rates  when  providing  KPI  results  to  AAECD. 


Note:  Given  past  experience,  most  institutions  in  the  college  sector  will  have  a higher  response  rate. 
Experience  also  shows  that  the  universities  will  have  to  make  a special  effort  to  obtain  a 50%  response 
rate. 


V.  Definitions  and  Calculations 


• All  percentages/rates  reported  by  AECD  use  the  number  of  respondents  for  a particular  question  as 
the  base  (e.g.,  if  60  individuals  were  surveyed,  but  only  52  answered  questions  about  hours  of  work, 
the  base  for  the  calculation  should  be  52). 

• Unemployment  rates  (“unemployment”  being  defined  as  “not  employed  but  actively  looking  for 
work”)  are  calculated  in  the  standard  manner  [i.e.,  no.  of  unemployed/(no.  of  employed  + no.  of 
unemployed)]. 

• Part-time  employment  is  defined  as  working  less  than  30  hours  per  week  in  a single  job  or,  for 
multiple-job  holders,  working  less  than  30  hours  per  week  in  the  main  job  (the  “main  job”  is  the  job 
with  the  most  hours). 

• Total  monthly  salary  is  defined  as  the  sum  of  a respondent’ s salary  in  her/his  main  job  and  in  all 
other  jobs.  When  reporting  total  monthly  salary  for  full-time  employed  respondents,  only  those 
multiple-job  holders  working  at  least  30  hours  per  week  in  their  main  job  (i.e.,  multiple  job-holders 
with  at  least  one  full-time  job)  should  be  included  in  the  calculation  (along  with  the  full-time 
employed  with  only  one  job). 


NOTE:  In  the  employment  questionnaire  (Q5a  and  Q6a  in  the  telephone  version;  Q6a  and  Q7a  in  the 
self-administered  version),  respondents  are  asked  to  report  their  gross  salary  or  earnings  (for  their  first 
job/  and  for  all  other  jobs,  if  more  than  one).  They  are  then  asked  to  indicate  the  pay  period  they  used  in 
providing  the  answer  (Q5b  and  Q6b  in  the  telephone  version;  Q6b  and  Q7b  in  the  self-administered 
version).  When  reporting  average  monthly  salary  for  all  employed  and  for  those  employed  full-time, 
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institutions  must  use  the  information  on  gross  salary  and  pay  period  (as  well  as  the  number  of  hours 
worked,  if  necessary)  to  do  their  calculations. 

Titus,  for  their  oniv/main  job,  if  respondents  report: 

• their  annual  salary,  the  amount  should  he  divided  by  ! 2 

• bi-weekly  earnings,  the  amount  should  be  multiplied  by  2 

• weekly  earnings*  the  amount  should  be  multiplied  by  4 

• daily  earnings,  the  amount  should  be  multiplied  by  [(number  of  hours  per  week/8)  *4] 

• hourly  earnings,  the  amount,  should  be  multiplied  by  [(number  of  hours  per  week)  * 4] 

If  a respondent  has  two  or  more  jobs,  die  same  calculations  should  be  done  tor  these  additional 
jobs,  and  this  (monthly)  amount  should  be  added  to  the  monthly,  salary  from  die  main  job. 

AECD  recognizes  the  additional  burden  these  calculations  place  on  institutions.  However*  the 
alternative  would  be  to  ask  respondents  who  are  not  paid  inontMy  to  do  such  calculations  while 
completing  the  interview  or  questionnaire.  If  so,  the  potential  for  significant  reporting  error  would  be 
very  high. 


VI.  Reporting  Procedures 

• For  both  the  satisfaction  and  the  employment  surveys,  institutions  are  required  to  report  KPI  data  at 
die  program  level  if  there  were  at  least  three  respondents  from  that  program  for  a particular  required 
KPI  variable  (i.e„  if  3 respondents  answered  for  variable  X but  only  2 answered  for  variable  Y,  the 
institution  will  not  be  required  to  report  results  for  variable  Y). 


Note:  AECD  will  not  publicly  report  data  at  the  program  level  if  fewer  than  ten  completers/graduates 
responded  in  a survey.  Institutions  are  being  asked  to  report  data  if  at  least  three  compleiers/graduaies 
responded  so  that  the  data  can  be  “rolled  up”  across  like  programs  in  different  institutions. 


• Along  with  program-level  responses  to  die  required  KPI  questions,  institutions  must  report:  1)  how 
their  KPI  data  were  collected  (telephone  or  self-administered  questionnaire);  2)  if  and  how  any 
modifications  were  made  to  the  survey  introduction  (or  cover  letter)  or  the  data  collection  protocols; 
and  3)  the  (overall)  response  rate  obtained  in  their  survey. 


VII.  Response  Rate  Adjustment  Factor  for  Employment  Statistics 

• In  the  past,  AECD  has  used  a “response  rate  adjustment  factor”  to  adjust  KPI  results  (at  the 
institution  level  only)  reported  to  them  by  institutions.  This  adjustment  factor  has  almost  no  impact 
on  survey  estimates  if  response  rates  are  high.  It  has  limited  impact  on  survey  estimates  for 
institutions  with  large  numbers  of  program  completers/graduates,  if  response  rates  are  reasonably 
high.  However,  for  small  institutions  with  low  response  rates,  it  might  lead  to  a noticeable  downward 
adjustment  of  survey  estimates  (e.g.,  employment  rates  adjusted  downward  from  90%  to  85%). 

• AECD  will  continue  to  use  this  adjustment  factor  in  order  to  encourage  institutions  to  strive  for 
higher  response  rates  in  their  KPI  surveys. 

• The  following  comments  discuss  the  “response  rate  adjustment  factor”  in  more  detail,  using 
employment  rates  as  the  example.  However,  AECD  also  adjusts  other  KPI  results  (e.g.,  part-time 
rates,  continued  enrollment  rates,  the  proportion  of  graduates  who  are  satisfied  with  their  program). 
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Explanation  of  the  “response  rate  adjustment  factor  ” 

• Survey  results  provide  an  estimate  of  the  actual  employment  rate  (the  population  parameter)  for  all 
graduates  in  an  institution.  The  estimated  employment  rate  will  rarely  be  identical  to  the  actual 
employment  rate.  Actual  employment  rates  will  fall  within  a range  of  values.  The  inherent  risk  of 
sampling  (and  low  response  rates)  increases  the  size  of  the  range.  The  adjusted  survey  estimate 
represents  the  lowermost  possible  actual  employment  rate,  using  a 80%  confidence  interval. 

• Each  institution  surveyed  all  graduates  in  their  parchment  programs.  Each  institution  has  a different 
number  of  graduates,  and  experienced  a different  level  of  success  obtaining  responses.  These 
differences  need  to  be  compensated  for  before  the  data  is  strictly  comparable.  A standard  statistical 
method  uses  the  following  standard  formula  to  predict  the  range  within  which  the  actual  employment 
rate  will  fall: 

P ± Zo/2  * ((P  *(1  - P))/n)A.5  * ((N-n)/(N-l))A.5 


Employment  Rate  Confidence  level  Standard  deviation 


This  is  an  estimate  of  the 
actual  employment  rate. 
Two  factors  affect  the 
accuracy  of  the  estimate. 
First,  as  the  sample  gets 
smaller,  the  sample  may 
not  be  representative  of  the 
population.  Second,  as  the 
sample  becomes  a smaller 
proportion  of  the 
population  the  results  may 
be  less  representative  of 
the  population.  As  the 
risks  get  higher  the  width 
of  the  interval  within  with 
the  actual  employment  rate 
may  fall  will  increase. 


The  only  range  of  potential 
intervals  that  includes  all 
theoretically  possible 
sample  employment  rates 
is  0%  to  100%.  As  we 
allow  for  some  risk  that  the 
actual  employment  rate 
falls  outside  the  range,  the 
range  can  be  narrowed. 
Using  Z to  represent  the 
normal  probability 
distribution  we  can  control 
this  risk.  We  are  using  an 
80%  confidence  level. 


(P*(l-P))/n 

This  proportion  of  the 
formula  calculates  the 
standard  deviation.  This 
factor  adjusts  the  possible 
range  of  actual 
employment  rates,  for  the 
statistically  estimated 
dispersion  of  the  sample 
results  around  the  actual 
employment  rate.  As  the 
actual  employment  rate 
gets  closer  to  100%  the 
range  of  possible  sample 
results  decreases.  This 
number  also  becomes 
smaller  as  the  absolute  size 
of  the  sample  increases. 


Sample  size 


(N-n)/(N-l) 

This  is  know  as  the  finite 
population  correction 
factor.  It  adjusts  the  range 
to  reflect  the  drop  in  risk 
of  sample  error  as  the 
sample  size  approaches  the 
size  of  the  population.  No 
sample  error  occurs  if  the 
sample  is  the  same  size  as 
the  population. 


• While  the  formula  provides  a range  within  which  the  actual  employment  rate  falls,  only  the  lower 
boundary  is  used  by  AECD  when  adjusting  KPI  results.  The  lower  boundary  will  focus  the 
discussion  and  rewards  on  quality  issues.  The  focus  will  be  on  improving  the  lowest  possible  actual 
employment  rate,  as  estimated  by  the  survey  results.  The  lower  limit  is  therefore  a comparable 
estimate  of  the  actual  employment  rate  as  it  adjusts  for  the  estimated  employment  rate,  the  survey 
response  rate,  and  the  gross  number  of  responses  received. 

• Institutions  can  estimate  the  relative  effect  investments  into  dealing  with  each  of  these  factors  will 
have  on  their  performance  outcomes.  In  short,  it  is  in  an  institution’s  best  interest  to  obtain  response 
rates  as  high  as  possible  in  their  KPI  surveys. 
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Employment  Survey 

Telephone  Survey  version 


INTRODUCTION 

Hello,  my  name  is  ______  and  Fm  calling  {long  distance ) on  behalf  of (name  of 

institution). 

May  I please  speak  to  ________  (name  of  graduate)? 

[If  the  individual  is  not  available,  try  to  find  out  when  they  might  be  available.  Explain  purpose  of 
study  (see  below)  if  requested.  Thank  the  person  providing  the  information.  Do  not  collect  survey 
information  from  parents,  room-mates  or  others.] 

[If  the  individual  does  not  live  in  this  household,  try  to  obtain  a new  telephone  number.  Explain 
purpose  of  study  (see  below)  If  requested.  Thank  the  person  providing  the  information.] 

We  are  doing  a study  of  the  people  who  graduated  from  {completed  programs  at)  

(name  of  institution)  in  199X.  The  purpose  of  the  study  is  to  provide  information  for  Alberta  Advanced 
Education  and  Career  Development  about  how  well  graduates  of  your  program  are  doing  in  the  job 
market,  and  to  provide  _______  (name  of  institution)  with  ideas  about  how  to  improve  their 

programs. 

Your  name  was  selected  from  the  list  of  all  graduates  {people  who  completed  programs ).  I would  like  to 
Interview  you  and  hope  now  Is  a good  time.  The  interview  will  take  about  XX  minutes,  depending  on 
how  many  of  the  questions  you  answer. 

[If  the  individual  is  unwilling  to  be  interviewed  at  this  time,  try  to  arrange  another  more 
convenient  time.] 

Before  we  start,  Fd  like  to  assure  you  that  your  participation  is  voluntary  and  that  any  information  you 
give  us  will  be  kept  completely  confidential.  When  we  summarize  the  results,  only  group  averages  will 
be  calculated,  and  no  individuals  will  be  identified.  If  there  are  any  questions  you  do  not  want  to  answer, 
please  feel  free  to  say  so,  and  I’ll  go  on  to  the  next  question.  You  can  also  stop  the  interview  at  any  time, 
if  you  wish. 

For  your  information,  this  survey  is  being  conducted  under  the  guidelines  of  the  Government 
Organization  Act.  If  you  have  any  questions  regarding  this  survey,  or  about  the  Freedom  of  Information 
and  Privacy  Act,  please  feel  free  to  contact  (name  of  FODP  coordinator)  who  is  the 

Freedom  of  Inf ormation  coordinator  at  _____  (name  of  institution).  Her/his  phone  number  is  (403)  - 
xxx-xxxx. 


CONFIRMING  IN STITUTTQN/PRQGR  AM  STATUS 


First,  I would  like  to  confirm  some  information  about  the  post-secondary  program  you  completed. 


Did  you  receive  a (degree/diploma/certificate)  in  ______  (name  of  program)  in 

(year)  from  (name  of  institution)? 


Yes 1 

No  2 [If  ‘no%  obtain  correct  information  about  program  of  study.] 


KPI  Reporting  Manual  - Appendix  A 


Page  119 


December  1998 


REQUIRED  QUESTIONS 


1.  Do  you  currently  have  one  or  more  paving  jobs,  including  self-employment? 

Yes,  one  job 1 

Yes,  more  than  one  job 2 

No 3 [GO  TO  Q.  8] 

No  response 9 [GO  TO  Q.  8] 

2.  What  is  the  total  number  of  hours  you  usually  work  per  week  in  your  {main)  job? 

[The  main  job  refers  to  the  one  with  the  most  hours  worked  in  a week.] 

(total  hours  per  week)  [IF  ONE  JOB  ONLY,  GO  TO  Q.  4] 

3.  [ASK  IF  MORE  THAN  ONE  JOB  (i.e.,  if  answer  of  ‘2’  to  Q.  1)] 

What  is  the  total  number  of  hours  you  usually  work  per  week  in  all  your  jobs  combined? 
(total  hours  per  week) 

4.  Are  you  self-employed  (in  your  main  job)l 


Yes 1 

No 2 


No  response 9 

5a.  Working  your  usual  hours  at  your  current  (main)  job,  approximately  what  is  your  gross  salary  or 
earnings,  before  taxes  and  deductions? 

($  amount) 

Don’ t know/No  response  ......  0 

5b.  RECORD  PAY  PERIOD  USED  BY  RESPONDENT  [PROBE,  IF  NECESSARY] 


Hourly 1 

Daily 2 

Weekly 3 

Bi-weekly 4 

Monthly 5 

Yearly 6 

No  response 9 


[IF  ONE  JOB  ONLY.  GO  TO  Q.  7] 

6a.  [ASK  O.  6a  and  6b  IF  MORE  THAN  ONE  JOB  (i.e.,  if  answer  of  ‘2’  to  Q.  1)] 

Approximately  what  is  your  gross  salary  or  earnings  in  your  other  job(s),  before  taxes  and 
deductions,  working  your  usual  hours? 

($  amount) 

Don’t  know/No  response 0 
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6b.  RECORD  PAY  PERIOD  USED  BY  RESPONDENT  [PROBE,  IF  NECESSARY] 


Hourly 1 

Daily  2 

Weekly  ..................  3 

Bi-weekly  4 

Monthly  5 

Yearly  6 

No  response 9 


7a.  In  terms  of  the  subject-area  knowledge  you  acquired  (e.g.,  history,  welding,  etc.)  how  related  is  your 
current  (main)  job  to  the  program  from  which  you  graduated?  Please  answer  on  a 5-point  scale  where 
1 means  “not  at  all  related ” and  5 means  “very  related.  ” 


Very  related  5 

......  4 

3 

......  2 

Not  at  all  related  ........  1 

No  response  9 


7b.  In  terms  of  the  general  skills  and  abilities  you  acquired  (e.g.,  communication  skills,  problem-solving, 
etc.),  how  related  is  your  current  (main)  job  to  the  program  from  which  you  graduated?  Again,  please 
answer  on  a 5 -point  scale  where  1 means  “not  at  all  related ” and  5 means  “very  related.  ” 


Very  related  5 

......  4 

3 

......  2 

Not  at  all  related  ........  1 

No  response  9 


IF  RESPONDENT  IS  CURRENTLY  EMPLOYED,  GO  TO  0, 9 

8.  Are  you  currently  looking  for  a job? 

Yes 1 

No.. 2 

No  response  9 

9.  Are  you  currently  a student  in  a post-secondary  program? 

Yes  1 

No 2 [GO  TO  Q.  11] 

No  response  ............  9 [GO  TO  Q.  11] 

10.  Are  you  enrolled  primarily  as  a:  [READ] 

Full-time  student 1 

or  a part-time  student ...........  2 

No  response  9 
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1 1.  Do  you  plan  to  enroll  (in  this  or  another ) post-secondary  institution  for  credit  within  the  next  year, 
within  the  next  several  years,  or  do  you  not  have  any  further  enrollment  plans  at  this  time? 


Within  the  next  year 1 

Within  the  next  several  years 2 

No  immediate  plans  to  enroll 3 

No  response 9 


COMPLEMENTARY  QUESTIONS  [optional;  chosen  by  institutions] 


Thank  you  for  participating  in  this  study.  We  appreciate  the  time  you  have  taken  to  answer  our  questions. 
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Satisfaction  Survey 

Telephone  Survey  version 


INTRODUCTION 

Hello,  my  name  is and  I’m  calling  on  behalf  of  (name  of 

Institution). 

May  I please  speak  to  __________  (name  of  student)? 

[If  the  individual  is  not  available,  try  to  find  out  when  they  might  be  available.  Explain  purpose  of 
study  (see  below)  if  requested.  Thank  the  person  providing  the  information.  Do  not  collect  survey 
information  from  parents,  room-mates  or  others.] 

[If  the  individual  does  not  live  in  this  household,  try  to  obtain  a new  telephone  number.  Explain 
purpose  of  study  (see  below)  if  requested.  Thank  the  person  providing  the  information.] 

We  are  doing  a study  of  the  people  who  are  currently  completing  programs  of  study  at  

(name  of  institution).  Hie  purpose  of  the  study  is  to  provide  information  for  Alberta  Advanced  Education 

and  Career  Development  about  how  satisfied  students  are  with  their  program  of  study,  and  to  provide 

_______  (name  of  institution)  with  ideas  about  how  to  improve  their  programs. 

Your  name  was  selected  from  the  list  of  all  students  cuirently  completing  programs.  I would  like  to 
interview  you  and  hope  now  is  a good  time.  The  interview  will  take  about  XX  minutes,  depending  on 
how  many  of  the  questions  you  answer. 

[If  the  individual  is  unwilling  to  be  interviewed  at  this  time,  try  to  arrange  another  more 
convenient  time.] 

Before  we  start.  I'd  like  to  assure  you  that  your  participation  is  voluntary  and  that  any  information  you 
give  us  will  be  kept  completely  confidential.  When  we  summarize  the  results,  only  group  averages  will 
be  calculated,  and  no  individuals  will  be  identified.  If  there  are  any  questions  you  do  not  want  to  answer, 
please  feel  free  to  say  so,  and  I’ll  go  on  to  the  next  question.  You  can  also  stop  the  interview  at  any  time, 
if  you  wish. 

For  your  information,  this  survey  is  being  conducted  under  the  guidelines  of  the  Government 
Organization  Act.  If  you  have  any  questions  regarding  this  survey,  or  about  the  Freedom  oflnformation 
and  Privacy  Act,  please  feel  free  to  contact  (name  of  FOIP  coordinator)  who  is  the 

Freedom  oflnformation  coordinator  at  _____  (name  of  institution).  Her/his  phone  number  is  (403)  - 
xxx-xxxx 


CONFIRMING  IN STITUTIQN/PROGR AM  STATUS 

First,  I would  like  to  confirm  some  information  about  the  post-secondary  program  you  are  currently 
competing. 

Do  you  expect  to  receive  a (degree/diploma/certificate)  In  (name  of 


program)  from (name  of  institution)  in  the  near  future? 

Yes  1 

No 2 [If  ‘no’,  obtain  correct  information  about  program  of  study.] 
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REQUIRED  QUESTIONS 


1.  Let’s  begin  with  a few  questions  about  how  satisfied  you  are  with  your  program  of  study.  Using  a 5- 
point  scale  where  1 means  “ very  dissatisfied ” and  5 means  “ very  satisfied ,”  how  satisfied  are  you 
with: 

a.  The  relevance  of  your  courses? 


Very  satisfied 5 

4 

3 

2 

Very  dissatisfied ...........  1 

No  response 9 


b.  The  quality  of  teaching  in  your  program? 


Very  satisfied .5 

4 

3 

2 

Very  dissatisfied 1 

No  response 9 


c.  The  overall  quality  of  your  educational  experience? 


Very  satisfied  5 

4 

3 

2 

Very  dissatisfied 1 

No  response 9 


2.  To  what  extent,  do  you  believe  that  the  program  you  are  completing  improves  your  chances  of  getting 
a good  job?  Please  answer  on  a 5 -point  scale  where  1 means  “not  at  all”  and  5 means  “to  a great 


extent.  ” 

To  a great  extent 5 

4 

.........  3 

.........  2 

Not  at  all 1 

No  response 9 


3.  Using  the  same  response  scale,  where  1 means  “not  at  all”  and  5 means  “to  a great  extent ; ” to  what 
extent  did  your  program  of  study  provide  you  with  the  following  benefits? 

a.  The  skills  needed  for  a particular  job? 


To  a great  extent 5 

4 

3 

2 

Not  at  all 1 

No  response 9 
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b.  An  in-depth  knowledge  of  a particular  field  of  study? 

To  a great  extent 5 

4 

3 

2 

Not  at  all 1 

No  response 9 

c.  An  opportunity  to  improve  yourself  generally? 

To  a great  extent 5 

4 

3 

2 

Not  at  all 1 

No  response 9 

d.  Improved  chances  of  a good  income? 

To  a great  extent 5 

4 

3 

2 

Not  at  all 1 

No  response 9 

e.  An  opportunity  to  continue  your  education? 

To  a great  extent 5 

4 

3 

2 

Not  at  all 1 

No  response 9 

4.  If  you  could  choose  again,  would  you  choose  the  same  program  of  studies? 

Yes 1 

No 2 

No  response 9 

5.  If  you  could  choose  again,  would  you  choose  to  attend  (name  of  institution)? 

Yes 1 

No 2 

No  response 9 

COMPLEMENTARY  QUESTIONS  [optional;  chosen  by  institutions] 

Thank  you  for  participating  in  this  study.  We  appreciate  the  time  you  have  taken  to  answer  our  questions. 
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Employment  Survey 

Self-Administered  version  ( mail  survey  or  distribution  in  class ) 


Dear  Graduate, 


(name  of  institution)  is  conducting  a study  of  recent  graduates  from  your  program  of 

study.  The  purpose  of  the  study  is  to  provide  information  for  Alberta  Advanced  Education  and  Career 

Development  about  how  well  graduates  of  your  program  are  doing  in  the  job  market,  and  to  provide  

(name  of  institution)  with  ideas  about  how  to  improve  their  programs. 

Your  name  was  selected  from  the  list  of  all  graduates  (people  who  completed  programs)  in  19XX.  We 
would  appreciate  it  if  you  could  take  about  XX  minutes  to  complete  this  questionnaire.  While  your 
participation  is  voluntary,  and  you  can  skip  any  questions  you  do  not  wish  to  answer,  it  will  be  very 
helpful  for  us  if  you  answered  all  the  questions.  You  will  not  be  asked  to  sign  your  name  to  the 
questionnaire.  When  we  summarize  the  results,  only  group  averages  will  be  calculated. 

For  your  information,  this  survey  is  being  conducted  under  the  guidelines  of  the  Government 
Organization  Act.  If  you  have  any  questions  regarding  this  survey,  or  about  the  Freedom  of  Information 

and  Privacy  Act , please  feel  free  to  contact (name  of  FOIP  coordinator)  who  is  the 

Freedom  of  Information  coordinator  at (name  of  institution).  Her/his  phone  number  is  (403)  - 

xxx-xxxx 


Thank  you  for  assisting  us  by  participating  in  this  study. 
Sincerely, 
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INSTRUCTIONS 


Please  answer  the  following  questions  either  by  circling  the  number  next  to  the  most  appropriate 
answer,  or  by  writing  your  answer  in  the  space  provided. 


First,  we  would  like  to  confirm  some  information  about  the  post-secondary  program  you  completed  in 
19XX.  Our  records  show  that  you  received  the  following  (degree/diploma/certificate)? 


Yes 1 

No 2 [If  this  information  is  not  correct, 

please  make  the  necessary  corrections.] 


2.  Do  you  currently  have  one  or  more  paving  jobs  (including  self-employment)? 

Yes,  one  job 1 

Yes,  more  than  one  job  .......  2 

No  job 3 [GO  TO  Q.  9] 

3.  What  is  the  total  number  of  hours  you  usually  work  per  week  in  your  job? 

[If  you  have  more  than  one  job,  answer  with  respect  to  your  MAIN  JOB, 
that  is,  the  one  in  which  you  work  the  most  hours  per  week.] 

(total  hours  per  week) 

IF  YOU  CURRENTLY  HAVE  ONLY  ONE  JOB.  GO  TO  Q.  5 -> 

4.  What  is  the  total  number  of  hours  you  usually  work  per  week  in  all  your  jobs  combined? 

(total  hours  per  week  in  all  jobs) 

->5.  Are  you  self-employed?  [If  you  have  more  than  one  job, 

answer  with  respect  to  your  MAIN  JOB] 


Yes 1 

No 2 


6a.  Working  your  usual  hours  at  your  current  job,  approximately  what  is  your  gross  salary  or  earnings, 
before  taxes  and  deductions?  [If  you  have  more  than  one  job,  answer  with  respect  to  your  MAIN 
JOB] 

($  amount) 
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6b.  Please  indicate  the  pay  period  you  are  referring  to  in  Q.  6a  above.  Are  you  paid: 


Hourly 1 

Dally 2 

Weekly 3 

Bi-weekly 4 

Monthly 5 

Yearly  6 


IF  YOU  CURRENTLY  HAVE  ONLY  ONE  JOB,  GO  TO  Q.  8a 

la.  Approximately  what  is  your  gross  salary  or  earnings  in  your  other  iob(s).  before  taxes  and 
deductions,  working  your  usual  hours? 

($  amount) 

7b.  Please  indicate  the  pay  period  you  are  referring  to  in  Q.  7a  above.  Are  you  paid: 


Hourly 1 

Daily  2 

Weekly 3 

Bi-weekly .4 

Monthly 5 

Yearly  6 


->  ->  8a.  In  terms  of  the  subject-area  knowledge  you  acquired  (e.g.,  history,  welding,  etc.)  how  related  is  your 
current  job  to  the  program  from  which  you  graduated?  [If  you  have  more  than  one  job,  answer 
with  respect  to  your  MAIN  JOB] 

Very  related  Not  at  all  related 

5 4 3 2 1 


8b.  In  terms  of  the  general  skills  and  abilities  you  acquired  (e.g.,  communication  skills,  problem-solving, 
etc.),  how  related  is  your  current  job  to  the  program  from  which  you  graduated?  [If  you  have  more 
than  one  job,  answer  with  respect  to  your  MAIN  JOB] 

Very  related  Not  at  all  related 

5 4 3 2 1 

IF  YOU  ARE  CURRENTLY  EMPLOYED,  GO  TO  Q.  10 


9.  Are  you  currently  looking  for  a job? 


Yes..... 1 

No 2 


10.  Are  you  currently  a student  in  a post-secondary  program? 


Yes 1 

No  2 [GO  TO  Q.  12] 
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1 1 . Are  you  enrolled  primarily  as  a: 


Full-time  student 1 

Part-time  student 2 


12.  Do  you  plan  to  enroll  (in  this  or  another ) post-secondary  institution  for  credit  within  the  next  year, 
within  the  next  several  years,  or  do  you  not  have  any  further  enrollment  plans  at  this  time? 


Within  the  next  year 1 

Within  the  next  several  years 2 

No  immediate  plans  to  enroll 3 


COMPLEMENTARY  QUESTIONS  [optional;  chosen  by  institutions] 


Thank  you  for  participating  in  this  study.  We  appreciate  the  time  you  have  taken  to  answer  our  questions. 
Please  return  your  questionnaire  in  the  envelope  provided.  Do  not  sign  your  name. 
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Satisfaction  Survey 

Self-Administered  version  (mail  survey  or  distribution  in  class) 


Dear  Student, 


____________  (name  of  institution)  is  conducting  a study  of  people  currently  completing  their 

programs.  The  purpose  of  the  study  is  to  provide  information  for  Alberta  Advanced  Education  and  Career 

Development  about  how  satisfied  students  are  with  their  program  of  study,  and  to  provide  _ 

. ... (name  of  institution)  with  ideas  about  how  to  improve  their  programs. 

Your  name  was  selected  from  the  list  of  all  those  completing  programs  in  19XX.  We  would  appreciate  it 
if  you  could  take  about  XX  minutes  to  complete  this  questionnaire.  While  your  participation  is  voluntary, 
and  you  can  skip  any  questions  you  do  not  wish  to  answer,  it  will  be  very  helpful  for  us  if  you  answered 
all  the  questions.  You  will  not  be  asked  to  sign  your  name  to  the  questionnaire.  When  we  summarize  the 
results,  only  group  averages  will  be  calculated. 

For  your  information,  this  survey  is  being  conducted  under  the  guidelines  of  the  Government 
Organization  Act.  If  you  have  any  questions  regarding  this  survey,  or  about  the  Freedom  of  Information 
and  Privacy  Act,  please  feel  free  to  contact  (name  of  FOIP  coordinator)  who  is  the 

Freedom  of  Information  coordinator  at (name  of  institution).  Her/his  phone  number  is  (403)  - 

xxx-xxxx 


Thank  you  for  assisting  us  by  participating  in  this  study. 
Sincerely, 
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INSTRUCTIONS 


Please  answer  the  following  questions  either  by  circling  the  number  next  to  the  most  appropriate 
answer,  or  by  writing  your  answ  er  in  the  space  provided. 


First,  we  would  like  to  confirm  some  information  about  the  post-secondary  program  you  are  currently 
completing.  Our  records  show  that  you  are  expected  to  receive  the  following 
(degree/diploma/certificate) . 


INSERT  LABEL  IDENTIFING  degree/diploma/certificate  AND  name  of  program 


1.  Is  this  information  correct? 


Yes 1 

No 2 [If  this  information  is  incorrect, 

please  make  the  necessary  corrections.] 


2.  The  next  few  questions  ask  about  how  satisfied  you  are  with  your  program  of  study.  Using  a 5-point 
scale  where  1 means  “ very  dissatisfied ” and  5 means  “ very  satisfied ,”  how  satisfied  are  you  with: 

a.  The  relevance  of  your  courses? 

Very  satisfied  Very  dissatisfied 

5 4 3 2 1 

b.  The  quality  of  teaching  in  your  program? 

Very  satisfied  Very  dissatisfied 

5 4 3 2 1 

c.  The  overall  quality  of  your  educational  experience? 

Very  satisfied  Very  dissatisfied 

5 4 3 2 1 

3.  To  what  extent,  do  you  believe  that  the  program  you  are  completing  improves  your  chances  of  getting 
a good  job?  Please  answer  on  a 5-point  scale  where  1 means  “not  at  air  and  5 means  “to  a great 
extent. 

To  a great  extent  Not  at  all 

5 4 3 2 1 
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4.  To  what  extent  did  your  program  of  study  provide  you  with  the  following  benefits? 

a.  The  skills  needed  for  a particular  job? 

To  a great  extent  Not  at  all 

5 4 3 2 1 

b.  An  in-depth  knowledge  of  a particular  field  of  study? 

To  a great  extent  Not  at  all 

5 4 3 2 1 

c.  An  opportunity  to  improve  yourself  generally? 

To  a great  extent  Not  at  all 

5 4 3 2 1 

d.  Improved  chances  of  a good  income? 

To  a great  extent  Not  at  all 

5 4 3 2 1 

e.  An  opportunity  to  continue  your  education? 

To  a great  extent  Not  at  all 

5 4 3 2 1 

5.  If  you  could  choose  again,  would  you  choose  the  same  program  of  studies? 

Yes 1 

No . 2 

6.  If  you  could  choose  again,  would  you  choose  to  attend  _ (name  of  institution)? 

Yes 1 

No 2 


COMPLEMENTARY  QUESTIONS  [optional;  chosen  by  institutions] 


Thank  you  for  participating  in  this  study.  We  appreciate  the  time  you  have  taken  to  answer  our  questions. 
Please  return  your  questionnaire  in  the  envelope  provided.  Do  not  sign  your  name. 
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Appendix  B 

Alberta  Universities’  Student  Satisfaction  Survey  Instrument 


Hello.  May  I please  speak  to Hi,  my  name  is and  I’m 

calling  from  The  Advisory  Group.  We  are  conducting  a survey  on  behalf  of  the  Universities  of 
Alberta,  Calgary,  Lethbridge  and  Athabasca  University.  We  are  interested  in  finding  out  what  you 
think  of  your  educational  experience.  This  telephone  questionnaire  will  take  approximately  15 
minutes  of  your  time.  Your  participation  is  voluntary,  and  your  identity  as  a participant  is 
completely  confidential.  There  are  no  questions  that  will  identify  you  individually.  Would  you  be 
able  to  provide  that  time  for  us  now? 

[IF  YES,  CONTINUE.  IF  NO,  ARRANGE  CALLBACK: ] 

[ALL  STUDENTS  SHOULD  HAVE  BEEN  MAILED  A LETTER  FROM  THEIR  RESPECTIVE  UNIVERSITY 
INFORMING  THEM  OF  THIS  SURVEY.] 

[IF  THE  STUDENT  QUESTIONS  THE  VALIDITY  OF  THE  STUDY,  PLEASE  TELL  THEM  THEY  CAN 
CONTACT  THE  FOLLOWING  PERSON  FOR  VERIFICATION : 

U OF  A:  MR.  BRIAN  SILZER,  ASSOCIATE  V.P.  REGISTRAR,  492-3723 

U OF  C:  DR.  PEGGY  PATTERSON,  ASSOCIATE  VICE  PRESIDENT  (STUDENT  AFFAIRS),  220-6580 
U OF  L:  DR.  KEITH  McCURDY,  DEAN  OF  STUDENT  AFFAIRS,  329-2593 
AU:  DR.  RICK  POWELL,  HEAD  OF  INSTITUTIONAL  STUDIES,  675-6220] 

Section  One:  BACKGROUND  INFORMATION 

First  of  all,  I need  to  gather  some  background  information  from  you: 

1.1  From  what  Faculty  are  you  graduating: 

[INSTRUCTION  TO  INTERVIEWERS:  DO  NOT  READ  LIST.  CLARIFY  FACULTY  IF  NECESSARY. 
IF  FACULTY  NOT  LISTED,  OR  IF  MORE  THAN  ONE  FACULTY  IS  GIVEN,  SPECIFY  IN  ‘OTHER’. 
DO  NOT  USE  THE  OTHER  CATEGORY  WITHOUT  CHECKING  WITH  THE  SUPERVISOR  DURING 
YOUR  EDIT.  DO  NOT  CODE  MINORS.] 

University  of  Alberta: 

1 1 . Agriculture  and  Forestry  and  Home  Economics 

12.  Arts 

13.  Business 

14.  Dentistry 

15.  Education 

16.  Engineering 

17.  Law 

18.  Medicine 

19.  School  of  Native  Studies 

110.  Nursing 

111.  Pharmacy  & Pharmaceutical  Sciences 

112.  Physical  Education  & Recreation 

113.  Rehabilitation  Medicine 

1 14.  Saint-Jean 

115.  Science 

116.  Other  (i.e.,  if  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 
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0.  No  answer 

University  of  Calgary: 

21.  Education 

22.  Engineering 

23.  Fine  Arts 

24.  General  Studies 

25.  Humanities 

26.  Kinesiology 

27.  Law 

28.  Management 

29.  Medicine 

210.  Nursing 

211.  Science 

212.  Social  Sciences 

213.  Social  Work 

214.  Other  (i.e.,  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 


0.  No  answer 

University  of  Lethbridge: 

[INSTRUCTIONS  TO  INTERVIEWER:  IF  U OF  L STUDENT  RESPONDS,  “EDUCATION”  THIS 
MUST  BE  CLARIFIED  AS  EITHER  COMBINED  DEGREE  PROGRAM  (IE.,  A DUAL  DEGREES 
PROGRAM  IN  EDUCATION  AND  ANOTHER  FACULTY)  OR  THE  NON-COMB  INED  DEGREES 
PROGRAM.  IF  COMBINED  DEGREES  PROGRAM,  MARK  “31".  IF  NON-COMB  INED  DEGREES 
PROGRAM,  MARK  “33”.] 

3 1 . Education  and  another  faculty,  in  the  combined  degrees  program  in  teacher  preparation 
[INSTRUCTIONS  TO  INTERVIEWER:  IF  U OF  L RESPONSE  IS  “31”  MODIFY  THE 
WORDING  OF  QUESTIONS  3.3  AND  3.8  AS  SPECIFIED  LATER  ON.] 

32.  Arts  and  Science 

33.  Education  (excluding  combined  degrees  program) 

34.  School  of  Fine  Arts 

35.  Management 

36.  School  of  Nursing 

37.  Other  (i.e.,  Faculty  not  listed  above  or  if  more  than  one  Faculty,  excluding  the  Education 

combined  degrees  program,  please  specify) 

0.  No  answer 

Athabasca  University: 

41.  Arts 

42.  Administration 

43.  Commerce 

44.  General  Studies 

45.  Nursing 

46.  Science 

47.  Other  (i.e.,  Faculty  not  listed  above  or  if  more  than  one  Faculty,  please  specify) 


0.  No  answer 


1.2  What  degree(s)  will  be  awarded  to  you  at  convocation? 
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[INSTRUCTION  TO  INTERVIEWERS:  IF  MORE  THAN  ONE  DEGREE  GIVEN,  CLARIFY  AS  A 
DUAL  DEGREE  AND  LIST  BOTH.  DO  NOT  CODE  MINORS.] 


(record  verbatim) 


1.3  What  is  your  major? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  MORE  THAN  ONE  MAJOR  GIVEN,  CLARIFY  AS  A DUAL 
MAJOR  AND  LIST  BOTH.  DO  NOT  CODE  MINORS.] 


(record  verbatim) 


1.4  Did  you  enter  the  University  as  a transfer  student  (i.e.  you  received  some  advanced  credit 
for  work  accomplished  at  another  post-secondary  institution)? 

[INSTRUCTION  TO  INTERVIEWERS:  AFTER  DEGREE  STUDENTS  ARE  NOT  CONSIDERED 
“TRANSFER  STUDENTS.”] 

1.  Yes 

2.  No 

0.  No  answer 


Section  Two:  FINANCES 

The  next  section  has  two  questions  relating  to  finances. 

2.1  Considering  all  years  of  your  degree  program,  which  of  the  following  was  the  main  source  of 
financial  support  for  your  education?  I will  read  you  a list  of  possible  sources  so  you  can 
consider  all  of  them  in  your  response. 

[INSTRUCTIONS  TO  INTERVIEWER:  READ  LIST.  CLARIFY  RESPONSE  AS  MAIN  SOURCE.  IF 
MORE  THAN  ONE  RESPONSE  PROVIDED,  CLARIFY  EACH  AS  A MAIN  SOURCE.  ALLOW  UP  TO 
FOUR  RESPONSES.] 

1 . Parents 

2.  Spouse/partner 

3.  Personal  savings 

4.  Provincial  and/or  Canada  student  loans 

5.  Other  loans 

6.  Scholarships/bursaries 

7.  Employment  from  Co-op  work  term 

8.  Employment  during  school  term  (full  or  part-time) 

10.  Or  some  other  source  (please  specify) 

0.  No  answer  [DO  NOT  READ] 
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2.2  Did  you  receive  government  student  loans  to  help  finance  your  education? 

[IF  NO,  CIRCLE  “1",  AND  CONTINUE.] 

[IF  YES,  ASK:]  What  is  your  total  estimated  debt  load  at  the  time  of  graduation? 
[READ  LIST] 

1.  Nil 

2.  $5,000  or  less 

3.  $ 5,001  - 10,000 

4.  $10,001  - 15,000 

5.  $15,001  - 20,000 

6.  $20,001  - 25,000 

7.  $25,001  - 30,000 

8.  More  than  $30,000 

0.  No  answer  [DO  NOT  READ] 


Section  Three:  EDUCATIONAL  EXPERIENCE 

The  following  questions  ask  you  to  evaluate  various  aspects  of  your  educational  experience  at  the 
University.  For  all  of  these  items,  if  you  do  not  have  an  opinion,  please  say  so  and  we  will  go  on  to 
the  next  question.  Please  answer  on  a scale  of  1 to  5 where  1 means  very  dissatisfied,  2 is 
dissatisfied,  3 means  neither  satisfied  nor  dissatisfied,  4 is  satisfied,  and  5 means  very  satisfied. 


3.1 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 
11. 


How  would  you  rate  your  satisfaction  with  . . . [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  “NO  ANSWER.”  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Classrooms 
Laboratories 
Computer  facilities 
Library  holdings 
Library  hours 
Study  space 
Bookstore 
Safety  on  campus 
Registration 

Average  size  of  your  classes 
Course  material  packages 


Very  Neither  satisfied  Very  No  Answer 

Dissatisfied  Dissatisfied  nor  dissatisfied  Satisfied  Satisfied  [DO  NOT  READ] 


1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 
1 2 3 


4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
4 5 0 
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3.2 


1. 

2. 

3. 

4. 

5. 

6. 

7. 

8. 

9. 

10. 
11. 
12. 
13. 


Using  the  same  scale,  how  would  you  rate  your  satisfaction  with  any  of  the  following 
university  services  that  you  have  utilized?  Please  let  us  know  if  you  have  not  used  the 
service.  How  would  you  rate  . . . [READ  SCALE  AGAIN,  EF  NECESSARY.  READ  AND  ROTATE 
ITEMS]? 


[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  “NO  ANSWER.”  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Very  Neither  satisfied  Very 

Dissatisfied  Dissatisfied  nor  dissatisfied  Satisfied  Satisfied 


Services  for  students  with  disabilities  1 

University  residences  1 

Campus  recreation  facilities  1 

Campus  recreation  programs  1 

Parking  facilities  1 

Health  services  1 

Orientation  services  for  new  students  1 

Career  counselling  1 

Academic  advising  1 

Campus  food  services  1 

Personal/crisis  counselling  1 

Students’  Union 

University  day  care  1 


2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

2 3 4 5 

1 2 3 4 

2 3 4 5 


No  Answer 
[DO  NOT  READ] 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 

5 0 

0 


3.3  Please  answer  the  following  question  in  reference  to  the  courses  you  took  and  experiences 
you  had  in  your  own  Faculty . 


[INSTRUCTIONS  TO  INTERVIEWERS:  FOR  U OF  L STUDENTS  IN  THE  COMBINED  DEGREES 
PROGRAM  IN  TEACHER  PREPARATION,  REWORD  THE  QUESTION:  “PLEASE  ANSWER  THE 
FOLLOWING  QUESTION  IN  REFERENCE  TO  THE  COURSES  YOU  TOOK  AND  EXPERIENCES 
YOU  HAD  IN  THE  FACULTY  OF  EDUCATION ”] 

[FOR  STUDENTS  FROM  OTHER  UNIVERSITIES  IN  DUAL  FACULTIES,  ASK  THEM  TO 
RESPOND  IN  GENERAL  TO  BOTH  FACULTIES.] 

These  questions  are  phrased  as  statements;  please  indicate  whether  you  strongly  disagree, 
disagree,  neither  agree  nor  disagree,  agree,  or  strongly  agree  with  each  statement. 
[REPEAT  ANSWER  CHOICES  AFTER  EACH  QUESTION  IF  NECESSARY]. 

In  general,  most  of  your  instructors  . . . [READ  AND  ROTATE  ITEMS]? 


Strongly 

Disagree 


1 . Conducted  classes  in  a well-planned 

manner  1 

2.  Explained  concepts  clearly  1 

3.  Answered  students’  questions  clearly  1 

4.  Presented  course  materials  in  an 

interesting  way  1 

5.  Displayed  enthusiasm  in 

conducting  class  sessions  1 

6.  Showed  concern  for  student  progress  1 


Neither  agree 

Strongly 

No  Answer 

Disagree 

nor  disagree 

Agree 

Agree 

[DO  NOT  READ] 

2 

3 

4 

5 

0 

2 

3 

4 

5 

0 

2 

3 

4 

5 

0 

2 

3 

4 

5 

0 

2 

3 

4 

5 

0 

2 

3 

4 

5 

0 
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Strongly  Neither  agree  Strongly  No  Answer 

Disagree  Disagree  nor  disagree  Agree  Agree  [DO  NOT  READ] 


7.  Offered  to  help  students  with  problems  1 2 

8.  Treated  students  with  respect  1 2 

9.  Were  available  for  individual 

consultation  with  students  1 2 

10.  Communicated  course  objectives  and 

requirements  clearly  1 2 

1 1 . Met  the  course  objectives  in  their 

teaching  1 2 

12.  Used  methods  of  evaluation 
(e.g.,  quizzes,  assignments,  papers, 
exams)  that  provided  a fair  evaluation 

of  student  learning  1 2 

13.  Graded  student  work  promptly  1 2 

14.  Provided  helpful  comments  and 

feedback  where  appropriate  1 

15.  Were  effective  as  university  teachers  1 2 


3 4 5 0 

3 4 5 0 

3 4 5 0 

3 4 5 0 

3 4 5 0 

3 4 5 0 

3 4 5 0 

2 3 4 5 0 

3 4 5 0 


The  following  questions  examine  the  degree  to  which  your  education  at  the  University  has  added  to 
your  skills.  Again,  the  questions  are  phrased  as  statements  and  the  answer  categories  are  strongly 
disagree,  disagree,  neither  agree  nor  disagree,  agree,  and  strongly  agree. 

3.4  Reflecting  upon  your  educational  experience  at  the  University,  do  you  feel  that  it  has 
helped  you  to  . . . [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  “NO  ANSWER.”  REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Strongly 

Disagree 

Disagree 

Neither  agree 
nor  disagree 

Agree 

Strongly 

Agree 

No  Answer 
[DO  NOT  READ] 

1. 

Develop  problem-solving  skills 

0 

Speak  effectively 

1 

2 

3 

4 

5 

2. 

1 

2 

3 

4 

5 

0 

3. 

Write  effectively 

1 

2 

3 

4 

5 

0 

4. 

Develop  conflict-resolution  skills 

1 

2 

3 

4 

5 

0 

5. 

Become  motivated  to  acquire  knowledge 

1 

2 

3 

4 

5 

0 

6. 

Develop  self-confidence 

1 

2 

3 

4 

5 

0 

7. 

Develop  leadership  skills 

1 

2 

3 

4 

5 

0 

8. 

Think  creatively 

1 

2 

3 

4 

5 

0 

9. 

Develop  awareness  of  ethical  issues 

1 

2 

3 

4 

5 

0 

10. 

Develop  awareness  of  political  issues 

1 

2 

3 

4 

5 

0 

11. 

Appreciate  other  cultures 

1 

2 

3 

4 

5 

0 

12. 

Develop  computer  literacy 

1 

2 

3 

4 

5 

0 

13. 

Develop  information  management  skills 

1 

2 

3 

4 

5 

0 

14. 

Work  independently 

1 

2 

3 

4 

5 

0 

15. 

Work  well  with  others 

1 

2 

3 

4 

5 

0 

16. 

Develop  interpersonal  skills 

1 

2 

3 

4 

5 

0 
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The  following  questions  examine  your  reasons  for  attending  university.  Using  the  same  response 
categories  as  before,  please  state  your  level  of  agreement  to  each  statement  [READ  SCALE  AGAIN,  IF 
NECESSARY], 

3.5  Your  objective  in  attending  the  University  was  to  . . . [READ  AND  ROTATE  ITEMS]? 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 
FOR  ANY  REASON,  CODE  AS  “NO  ANSWER  ” REPEAT  ANSWER  CHOICES  AFTER  EACH 
QUESTION  IF  NECESSARY.] 


Answer 


Strongly  Neither  agree  Strongly  No 

Disagree  Disagree  nor  disagree  Agree  Agree  [DO  NOT  READ] 


1 . Find  opportunities  for  personal  development  1 2 3 4 5 0 

2.  Prepare  for  lifelong  learning  1 2 3 4 5 0 

3.  Qualify  for  another  program  of  studies  1 2 3 4 5 0 

4.  Improve  the  possibility  of  a good  income  1 2 3 4 5 0 

5.  Gain  skills  needed  for  a particular  career  1 2 3 4 5 0 

6.  Gain  in-depth  knowledge  of  a field  of  study  1 2 3 4 5 0 

7.  Acquire  breadth  of  knowledge 

of  a field  of  study  1 2 3 4 5 0 

8.  Friends  were  going  to  university  1 2 3 4 5 0 

9.  Aside  from  those  mentioned,  what  other  objectives,  if  any,  did  you  have  for  attending  University? 

(please  specify) 


SUPERVISOR:  CHECK  TO  ENSURE  RESPONSE  DOES  NOT  APPEAR  ABOVE] 


Again,  using  the  same  scale  as  before,  please  indicate  the  extent  to  which  the  program  you 
completed  provided  you  with  the  following  benefits? 

3.6  A Benefit  of  your  University  education  is  that  it . . . [READ  AND  ROTATE  ITEMS], 

[INSTRUCTION  TO  INTERVIEWERS:  IF  THE  STUDENT  IS  UNABLE  TO  EVALUATE  THE  ITEM 


FOR  ANY  REASON,  CODE  AS  “NO  ANSWER.” 

REPEAT  ANSWER  CHOICES  AFTER  EACH 

QUESTION  IF  NECESSARY.] 

Strongly 

Neither  agree 

Strongly 

No  Answer 

Disagree 

Disagree 

nor  disagree 

Agree 

Agree 

[DO  NOT  READ] 

1. 

Provided  skills  needed  for  a particular 

career 

1 

2 

3 

4 

5 

0 

2. 

Gave  you  in-depth  knowledge  of  a 
field  of  study 

1 

2 

3 

4 

5 

0 

3. 

Provided  an  opportunity  for 
personal  development 

1 

2 

3 

4 

5 

0 

4. 

Improved  the  possibility  of  a good 
income 

1 

2 

3 

4 

5 

0 

5. 

Allowed  you  to  qualify  for  another 
program  of  studies 

1 

2 

3 

4 

5 

0 

3.7  Using  the  descriptors  very  dissatisfied,  dissatisfied,  neither  satisfied  nor  dissatisfied, 
satisfied,  or  very  satisfied,  how  satisfied  are  you  with  the  overall  relevance  of  your 
program? 

Very  Neither  satisfied  Very  No  Answer 

dissatisfied  Dissatisfied  nor  dissatisfied  Satisfied  Satisfied  [DO  NOT  READ] 
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1 


0 
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3.8  Overall,  how  satisfied  are  you  with  the  courses  you  were  taught  in  your  own  faculty ? 

[READ  SCALE  AGAIN,  IF  NECESSARY.] 

[INSTRUCTIONS  TO  INTERVIEWERS:  FOR  U OF  L STUDENTS  IN  THE  COMBINED  DEGREES 
PROGRAM  IN  TEACHER  PREPARATION,  REWORD  THE  QUESTION:  “OVERALL,  HOW 
SATISFIED  ARE  YOU  WITH  THE  COURSES  YOU  WERE  TAUGHT  IN  THE  FACULTY  OF 
EDUCATION ? WOULD  YOU  SAY  YOU  ARE  VERY  DISSATISFIED,  DISSATISFIED,  NEITHER 
SATISFIED  NOR  DISSATISFIED,  SATISFIED,  OR  VERY  SATISFIED?] 

[FOR  STUDENTS  FROM  OTHER  UNIVERSITIES  IN  DUAL  FACULTIES,  ASK  THEM  TO 
RESPOND  IN  GENERAL  TO  BOTH  FACULTIES.] 


Very 

dissatisfied 

Dissatisfied 

Neither  satisfied 
nor  dissatisfied 

Satisfied 

Very 

Satisfied 

No  Answer 
[DO  NOTREAD] 

1 

2 

3 

4 

5 

0 

3.9  Overall,  how  satisfied  are  you  with  the  courses  you  were  taught  in  other  faculties?  [READ 

SCALE  AGAIN,  IF  NECESSARY.] 


Very 

dissatisfied 

Dissatisfied 

Neither  satisfied 
nor  dissatisfied 

Satisfied 

Very 

Satisfied 

No  Answer 
[DO  NOT  READ] 

1 

2 

3 

4 

5 

0 

3.10  Overall,  how  satisfied  are  you  with  the  quality  of  your  educational  experience ? 


[READ  SCALE  AGAIN,  IF  NECESSARY.] 

Very  Neither  satisfied 

Very 

No  Answer 

dissatisfied  Dissatisfied  nor  dissatisfied 

Satisfied 

Satisfied 

[DO  NOT  READ] 

1 2 3 

4 

5 

0 

3.11  If  you  could  choose  again,  would  you  choose  the  same  program  of  studies? 

1 Yes 

3 Maybe 

2 No 


3.12  If  you  could  choose  again,  would  you  choose  to  attend  the  same  university? 

1 Yes 

3 Maybe 

2 No 


This  concludes  the  Alberta  Universities’  Survey.  Thank  you  for  taking  the  time  to  reflect  on  your 
university  experience  and  to  share  your  thoughts. 


KPX  Reporting  Manual  - Appendix  B 


Page  141 


December  1998 


Appendix  C 


Private  Colleges’  Common  Questions  - Graduating  Student 
Satisfaction  Survey  - May  1996 


The  common  questions  agreed  to  by  the  four  private  colleges  and  included  in  the  Graduating  Student 
surveys  last  administered  are  as  follows: 

1 .6  What  degree  do  you  expect  to  receive  at  convocation? 

BA. 

B.Sc. 

BJEd.  (as  applicable) 

1 .7  Will  your  degree  be  a General  (3-year)  or  a Special  (4-year)  degree? 

General  (3-year) 

Special  (4-year) 

Certificate  of  Equivalence  (the  equivalent  of  a Special  Degree  for  holders  of  a previous  General 

degree) 


3.9  Please  rate  the  following  aspects  of  your  experience  at  ( institution ): 

Poor  Excellent 


a. 

the  effectiveness  of  the  instructors  from  whom  you 
have  taken  courses  at  ( institution ) 

1 

2 

3 

4 

5 

b. 

the  quality  of  courses  you  took  at  ( institution ) 

1 

2 

3 

4 

5 

c. 

the  relevance  of  your  educational  experience  at 
( institution ) to  your  educational  goals 

1 

2 

3 

4 

5 

d. 

the  quality  of  your  overall  educational  experience  at 
( institution ) 

1 

2 

3 

4 

5 

3.9  To  what  degree  did  the  program  you  completed  provide  you  with  the  following  benefits: 


Definitely 

Did  not 

Uncertain 

Provided 

Definitely 

did  not 

provide 

provided 

provide 

a. 

breadth  of  knowledge  1 

2 

3 

4 

5 

b. 

in-depth  knowledge  of  a field  of 

study  1 

2 

3 

4 

5 

c. 

an  opportunity  to  improve  yourself 
generally  1 

2 

3 

4 

5 

d. 

preparation  for  further  education  1 

2 

3 

4 

5 
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3.10  How  strongly  do  you  agree  or  disagree  with  the  following  statements: 


Strongly 

Strongly 

disagree 

agree 

I made  the  right  decision  in 

choosing  ( institution ) 1 

2 

3 

4 

5 

I made  the  right  decision  in 

choosing  my  program  of  studies  1 

2 

3 

4 

5 

I would  recommend  ( institution ) to 

a friend  or  relative  planning  to 

attend  university  1 

2 

3 

4 

5 
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Is: 


